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NETWORK SWITCH AND COMPONENTS AND METHOD OF OPERATION 
Technical Field 

5 This invention relates to communication network apparatus such as is used to 

link together information handling systems or computers of various types and 
capabilities and to components of such apparatus. In particular, this invention relates 
to scalable switch apparatus and components useful in assembling such apparatus. 
This invention relates to an improved and multi-functional interface device and the 
10 combination of that device with other elements to provide a media speed network 
switch. The invention also relates to methods of operating such apparatus which 
improve the data flow handling capability of network switches. 

Background Art 

15 

The description which follows presupposes knowledge of network data 
communications and switches and routers as used in such communications networks. 
In particular, the description presupposes familiarity with the ISO model of network 
architecture which divides network operation into layers. A typical architecture based 

20 upon the ISO model extends from Layer 1 (also sometimes identified as "L1") being 
the physical pathway or media through which signals are passed upwards through 
Layers 2, 3, 4 and so forth to Layer 7, the last mentioned being the layer of 
applications programming running on a computer system linked to the network. In this 
document, mention of L1, L2 and so forth is intended to refer to the corresponding 

25 layer of a network architecture. The disclosure also presupposes a fundamental 
understanding of bit strings known as packets and frames in such network 
communication. 

In today's networked world, bandwidth is a critical resource. Increasing 
30 network traffic, driven by the Internet and other emerging applications, is straining the 
capacity of network infrastructures. To keep pace, organizations are looking for better 
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technologies and methodologies to support and manage traffic growth and the 
convergence of voice with data. 

Today's dramatic increase in network traffic can be attributed to the popularity 
5 of the Internet, a growing need for remote access to information, and emerging 
applications. The Internet alone, with its explosive growth in e-commerce, has placed 
a sometimes insupportable load on network backbones. It is also the single most 
important cause of increased data traffic volumes that exceed voice traffic for the first 
time. The growing demands of remote access applications, including e-mail, 
10 database access, and file transfer, are further straining networks. 

The convergence of voice and data will play a large role in defining tomorrow's 
network environment. Currently, the transmission of data over Internet protocol (IP) 
networks is free. Because voice communications will naturally follow the path of lowest 

15 cost, voice will inevitably converge with data. Technologies such as Voice over IP 
(VoIP), Voice over ATM (VoATM), and Voice over Frame Relay (VoFR) are cost- 
effective alternatives in this changing market. However, to make migration to these 
technologies possible, the industry has to ensure quality of service (QoS) for voice and 
determine how to charge for voice transfer over data lines. The Telecommunications 

20 Deregulation Act of 1996 further complicates this environment. This legislation will 
reinforce a symbiotic relationship between the voice protocol of choice, ATM, and the 
data protocol of choice, IP. 

Integrating legacy systems is also a crucial concern for organizations as new 
25 products and capabilities become available. To preserve their investments in existing 
equipment and software, organizations demand solutions that allow them to migrate 
to new technologies without disrupting their current operations. 

Eliminating network bottlenecks continues to be a top priority for service 
30 providers. Routers are often the source of these bottlenecks. However, network 
congestion in general is often misdiagnosed as a bandwidth problem and is addressed 
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by seeking higher-bandwidth solutions. Today, manufacturers are recognizing this 
difficulty. They are turning to network processor technologies to manage bandwidth 
resources more efficiently and to provide the advanced data services, at wire speed, 
that are commonly found in routers and network application servers. These services 
5 include load balancing, QoS, gateways, fire walls, security, and web caching. 

For remote access applications, performance, bandwidth-on-demand, security, 
and authentication rank as top priorities. The demand for integration of QoS and CoS, 
integrated voice handling, and more sophisticated security solutions will also shape 
10 the designs of future remote access network switches. Further, remote access will 
have to accommodate an increasing number of physical mediums, such as ISDN, T1 , 
E1 , OC-3 through OC-48, cable, and xDSL modems. 

Industry consultants have defined a network processor (herein also mentioned 
15 as an "NP") as a programmable communications integrated circuit capable of 
performing one or more of the following functions: 

Packet classification ~ identifying a packet based on known characteristics, 
such as address or protocol 

20 Packet modification ~ modifying the packet to comply with IP, ATM, or other 

protocols (for example, updating the time-to-live field in the header for IP) 
Queue/policy management - reflects the design strategy for packet queuing, 
de-queuing, and scheduling of packets for specific applications 
Packet forwarding - transmission and receipt of data over the switch fabric and 

25 forwarding or routing the packet to the appropriate address 

Although this definition is an accurate description of the basic features of early 
NPs, the full potential capabilities and benefits of NPs are yet to be realized. Network 
processors can increase bandwidth and solve latency problems in a broad range of 
30 applications by allowing networking tasks previously handled in software to be 
executed in hardware. In addition, NPs can provide speed improvements through 
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architectures, such as parallel distributed processing and pipeline processing designs. 
These capabilities can enable efficient search engines, increase throughput, and 
provide rapid execution of complex tasks. 

5 Network processors are expected to become the fundamental network building 

block for networks in the same fashion that CPUs are for PCs. Typical capabilities 
offered by an NP are real-time processing, security, store and forward, switch fabric, 
and IP packet handling and learning capabilities. NPs target ISO layer two through 
five and are designed to optimize network-specific tasks. 

10 

The processor-model NP incorporates multiple general purpose processors and 
specialized logic. Suppliers are turning to this design to provide scalable, flexible 
solutions that can accommodate change in a timely and cost-effective fashion. A 
processor-model NP allows distributed processing at lower levels of integration, 
1 5 providing higher throughput, flexibility and control. Programmability can enable easy 
migration to new protocols and technologies, without requiring new ASIC designs. 
With processor-model NPs, NEVs benefit from reduced non-refundable engineering 
costs and improved time-to-market. 

20 Disclosure of the Invention 

One purpose of this invention is to provide a scalable switch architecture for 
use in a data communication network which is capable of sizing support capabilities 
to a range of potential demands while improving the speed of handling of data being 
25 transferred. This purpose is pursued by providing components, and assemblages of 
components, which remove from the workload of processing units involved a greater 
amount of data handling than has been the case heretofore. 

Another purpose is to provide an interface device or network processor (the 
30 terms being used interchangeably) which includes a plurality of sub-assemblies 
integrated on a single substrate and coacting to provide media rate switching of 
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frames that include layer 2, layer 3, layer 4 and layer 5. The interface device may be 
used as a standalone solution providing a first level of capability for a work group 
switch, an interconnected solution providing a higher level of capability work group 
switch or scaled further upward in capability by cooperation with a switching fabric 
5 device. 



Brief Description of the Drawings 



Some of the purposes of the invention having been stated, others will appear 
10 as the description proceeds, when taken in connection with the accompanying 
drawings, in which: 



Figure 1 shows a block diagram for an interface device in accordance with this 
invention. 

1 5 Figure 1 A shows a block diagram for the MAC. 

Figures 2A through 2D show the interface device interconnected with other 
components in different system configurations. 

Figure 3 shows the flow and processing of an encapsulated guided frame. 

Figure 4 shows the flow and processing of an internal guided frame. 
20 Figure 5 shows generalized format for a Guided Cell. 

Figure 6 shows the format for Frame Control Information. 

Figure 7 shows the format for the Correlator. 

Figure 8 shows Command Control Information Format. 

Figure 9 shows Addressing Information Format. 
25 Figure 10 shows General Form of Structure Addressing. 

Figure 11 shows chart for Addressing, Island Encoding. 

Figure 12A shows a block diagram of the Embedded Processor Complex. 

Figure 12B shows a schematic of the Embedded Processors. 

Figure 12C shows a structure for a GxH Processor. 
30 Figure 1 3 shows a block diagram of the memory complex. 

Figure 14 shows a flowchart for the Fixed Match(FM) search algorithm. 
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Figure 15 shows flows illustrating Data Structure without using a Direct Table and with 
using a Direct Table. 

Figure 16 shows a block diagram of a switching systems such as Prizma. 
Figure 17 shows a block diagram of a CP. 
5 Figure 18 shows a block diagram of the single chip Network Processor highlighting 
function in the EDS-UP, EDS DOWN and the EPC. 

Mode(s) for Carrying Out the Invention 

10 While the present inventions will be described more fully hereinafter with 

reference to the accompanying drawings, in which preferred embodiments of the 
present inventions are shown, it is to be understood at the outset of the description 
which follows that persons of skill in the appropriate arts may modify the inventions 
here described while still achieving the favorable results of the inventions. 

15 Accordingly, the description which follows is to be understood as being a broad, 
teaching disclosure directed to persons of skill in the appropriate arts, and not as 
limiting upon the present inventions. 

Apparatus disclosed here is scalable and capable of functioning to interconnect 
20 desktop or workgroup switches, aggregate such switches into a network backbone, 
and provide backbone switching services. The apparatus can support Layer 2, Layer 
3, and Layer 4+ forwarding in hardware. Certain forms of the apparatus are designed 
for desktop or workgroup switch aggregation and while others are targeted as core 
backbone switches. 

25 

The architecture used for the apparatus is based on an interface device or 
network processor hardware subsystem and a software library running on a control 
point, all as more fully described elsewhere in this document. The interface device or 
network processor subsystem is a high performance frame forwarding engine 
30 designed for parsing and translation of L2, L3, and L4+ protocol headers. This allows 
protocols to be switched at greater speeds using hardware. The interface device or 
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network processor subsystem provides a fast-path through the box while the software 
library and control point processor provide management and route discovery functions 
needed to maintain the fast-path. The control point processor and the software library 
running thereon together define the Control Point (CP) of the system. The CP is 
5 where the actual bridging and routing protocols such as Transparent Bridging and 
OSPF are run. It can also be referred to as the slow-path of the system. 

While the apparatus here disclosed supports multi-layer forwarding in hardware 
it can also operate as a L2 only switch and that is its default mode of operation in the 
10 simplest form disclosed. Each port will be put into a single domain allowing any 
device to communicate with any other device. The apparatus is configurable at L2 
allowing system administrators the ability to configure features such as; grouping ports 
into separate domains or trunks, configuring Virtual LAN (VLAN) segments, or filters 
to control broadcast and multicast traffic. 

15 

This scalable apparatus has many benefits. First, it allows the system 
administrator the ability to configure L3 forwarding and routing of IP and IPX traffic 
using the same hardware being used for L2 and at the same speed. Second, it 
removes the need for using external routers to interconnect campus buildings while 
20 increasing performance at the same time. Third, it simplifies or combines the 
management of L2/L3 service for a building into a single point of control. Finally, it 
provides value added features with L4+ functions that allow system administrators the 
ability to assign different traffic classifications to support mission critical applications 
and network dispatcher for load-balancing among servers. 

25 

The apparatus is designed to be a modular unit using an interface device or 
network processor, a Control Point (CP), and an optional switching fabric device as 
its fundamental building blocks. The interface device preferably provides L2/L3/L4+ 
fast-path forwarding services while the CP provides the management and route 
30 discovery functions needed to maintain the fast-path. The optional switching fabric 
device is used when more than two interface device subsystems are tied together. 
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The optional switching fabric device may be as disclosed in U.S. Pat. 5,008,878 
issued 16 April 1991 for High Speed Modular Switching Apparatus for Circuit and 
Packet Switched Traffic. 

5 The apparatus is anticipated to be assembled using printed circuit board 

elements also here mentioned as "blades". The printed circuit board elements have 
circuit elements mounted thereon and are received in connectors provided in 
apparatus housings. Similar devices are also know as "option cards". The apparatus 
contemplates that blades can be exchanged among varying chassis or housings, 

10 provided that appropriate connectors and backplane electrical connections are 
provided. The basic component found on all blades is a carrier subsystem. Starting 
with the carrier subsystem, three types of blades can be produced. The first type is 
a CP only Blade, which consists of a carrier subsystem and a CP subsystem. The 
primary use of a CP only blade is for a product where redundancy is the primary 

15 concern. The second type is a CP+Media Blade, which consists of a carrier 
subsystem, a CP subsystem, and 1-to-3 media subsystems. The primary use of a 
CP+Media blade is a product where port density is deemed more important than 
redundancy. The third type is a Media Blade, which consists of a carrier subsystem 
and 1-to-4 media subsystems. The media blades can be used in any chassis and the 

20 type of media subsystem used is configurable. 

Blade management will involve fault detection, power management, new device 
detection, initialization, and configuration. This management will be done using 
various registers, I/O signals, and a guided cell interface that is used to communicate 
25 between the CP and carrier subsystems. However, unlike the chassis there does exist 
programmable devices and memory on all blades. The amount of programmability 
depends on the type of blade. When the CP subsystem exists on a blade both the CP 
and carrier subsystems are programmable. The media subsystems are also 
programmable but only indirectly through the carrier subsystem. 

30 

In higher capability products there also exists a Switch Blade which contains 
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the switching fabric device subsystem. The management of this blade will involve fault 
detection, power management, new device detection, and initialization. This 
management will be done using various registers and I/O signals that will be mapped 
into the CP subsystem. 

5 

In its simplest form, a switch apparatus contemplated by this invention has a 
control point processor; and an interface device operatively connected to the control 
point processor. Preferably and as here disclosed, the interface device (also known 
as a network processor) is a unitary Very Large Scale Integrated (VLSI) circuit device 

10 or chip which has a semiconductor substrate; a plurality of interface processors 
formed on the substrate; internal instruction memory formed on said substrate and 
storing instructions accessibly to the interface processors; internal data memory 
formed on the substrate and storing data passing through the device accessibly to the 
interface processors; and a plurality of input/output ports. The interface processors 

1 5 are also sometimes herein identified as picoprocessors or processing units. The ports 
provided include at least one ports connecting the internal data memory with external 
data memory and at least two other ports exchanging data passing through the 
interface device with an external network under the direction of the interface 
processors. The control point cooperates with the interface device by loading into the 

20 instruction memory instructions to be executed by the interface processors in directing 
the exchange of data between the data exchange input/output ports and the flow of 
data through the data memory. 

The network processor here disclosed is deemed inventive apart from the 
25 switch assemblies into which it is incorporated. Further, the network processor here 
disclosed is deemed to have within its elements here described other and further 
inventions not here fully discussed. 

Figure 1 shows a block diagram for the interface device chip that includes 
30 substrate 1 0 and a plurality of sub-assemblies integrated on the substrate. The sub- 
assemblies are arranged into an Upside configuration and a Downside configuration. 



Cupii rl from KM !,S4 on (Hi/2 1/2007 



WO 01/16763 



10 



PCT/US00/20795 



As used herein, "Upside" refers to data flows inbound from a network to the apparatus 
here disclosed, while "Downside" refers to data outbound from the apparatus to a 
network serviced by the apparatus. The data flow follows the respective 
configurations. As a consequence, there is an Upside data flow and a Downside data 
5 flow. The sub-assemblies in the Upside include Enqueue-Dequeue-Scheduling UP 
(EDS-UP) logic 16, multiplexed MAC's-UP (PPM-UP) 14, Switch Data Mover-UP 
(SDM-UP) 18, System Interface (SIF) 20, Data Align Serial Link A (DASLA) 22, and 
Data Align Serial Link B (DASLB) 24. A data align serial link is more fully described 
in copending U.S. Patent Application Ser. No. 09/330,968 filed 11 June 1999 and 
10 entitled "High Speed Parallel/Serial Link for Data Communication". While the 
preferred form of the apparatus of this invention here disclosed uses a DASL link, the 
present invention contemplates that other forms of links may be employed to achieve 
relatively high data flow rates, particularly where the data flows are restricted to being 
within the VLSI structure. 

15 

The sub-assemblies in the downside include DASL-A 26, DASL-B 28, SIF 30, 
SDM-DN 32, EDS-DN 34, and PPM-DN 36. The chip also includes a plurality of 
internal S-RAM's, Traffic Mgt Scheduler 40, and Embedded Processor Complex 
(EPC) 12. An interface device 38 is coupled by respective DMU Busses to PMM 14 
20 and 36. The interface 38 could be any suitable L1 circuitry, such as ethernet Physical 
(ENET PHY), ATM Framer, etc. The type of interface is dictated in part by the 
network media to which the chip is connected. A plurality of external D-RAM's and S- 
RAM are available for use by the chip. 

25 While here particularly disclosed for networks in which the general data flow 

outside the relevant switching and routing devices is passed through electrical 
conductors such as wires and cables installed in buildings, the present invention 
contemplates that the network switches and components thereof here disclosed may 
be used in a wireless environment as well. By way of an illustrative example, the 

30 media access control (MAC) elements here described may be replaced by suitable 
radio frequency elements, possibly using known Silicon Germanium technology, which 
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would result in a capability to link the elements here described directly to a wireless 
network. Where such technology is appropriately employed, the radio frequency 
elements can, by person of appropriate skill in the applicable arts, be integrated into 
the VLSI structures here disclosed. Alternatively, radio frequency or otherwise 
5 wireless response devices such as infrared responsive devices can be mounted on 
a blade with other elements here disclosed to achieve a switch apparatus useful with 
wireless network systems. 

The arrows show the general flow of data within the Interface device. Frames 

1 0 received from an Ethernet MAC are placed in internal Data Store buffers by the EDS- 
UP. These frames are identified as either normal Data Frames or system control 
Guided Frames and enqueued to the EPC (Figure 1). The EPC contains N protocol 
processors capable of working on up to N frames in parallel (N>1 ). In an embodiment 
of ten protocol processor (Figure 12B), two of the ten protocol processors are 

15 specialized; one for handling Guided Frames (the Generic Central Handler or GCH) 
and one for building Lookup Data in Control Memory (the Generic Tree Handler or 
GTH). As shown in Figure 12A, the EPC also contains a dispatcher which matches 
new frames with idle processors, a completion unit which maintains frame sequence, 
a Common Instruction memory shared by all ten processors, a Classifier Hardware 

20 Assist which determines frame classification and coprocessor which helps determine 
the starting instruction address of the frame, Ingress and Egress Data Store interfaces 
which control read and write operations of frame buffers, a Control Memory Arbiter 
which allows the ten processors to share Control Memory, a Web Control, Arbiter and 
interface that allows debug access to internal Interface device data structures, as well 

25 as other hardware constructs. 

Guided Frames are sent by the dispatcher to the GCH processor as it becomes 
available. Operations encoded in the Guided Frame are executed, such as register 
writes, counter reads, Ethernet MAC configuration changes, and so on. Lookup table 
30 alterations, such as adding MAC or IP entries, are passed on to the Lookup Data 
processor for Control Memory operations, such as memory reads and writes. Some 
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commands, such as MIB counter reads, require a response frame to be built and 
forwarded to the appropriate port on the appropriate Interface device. In some cases, 
the Guided Frame is encoded for the Egress side of Interface device. These frames 
are forwarded to the Egress side of the Interface device being queried, which then 
5 executes the encoded operations and builds any appropriate response frame. 

Data frames are dispatched to the next available protocol processor for 
performing frame lookups. Frame data are passed to the protocol processor along 
with results from the Classifier Hardware Assist (CHA) Engine. The CHA parses IP 

10 or IPX. The results determine the Tree Search algorithm and starting Common 
Instruction Address (CIA). Tree Search algorithms supported included Fixed Match 
Trees (fixed size patterns requiring exact match, such as Layer 2 Ethernet MAC 
tables), Longest prefix Match Trees (variable length patterns requiring variable length 
matches, such as subnet IP forwarding) and Software Managed Trees (two patterns 

15 defining either a range or a bit mask set, such as used for filter rules). 

Lookup is performed with the aid of the Tree Search Engine (TSE) 
Coprocessor, which is a part of each protocol processor. The TSE Coprocessor 
performs Control memory accesses, freeing the protocol processor to continue 
20 execution. Control memory stores all tables, counters, and other data needed by the 
picocode. Control memory operations are managed by the Control memory Arbiter, 
which arbitrates memory access among the ten processor complexes. 

Frame data are accessed through the Data Store Coprocessor. The Data Store 
25 Coprocessor contains a primary data buffer (holding up to eight 16 byte segments of 
frame data), a scratch pad data buffer (also holding up to eight 16-byte segments of 
frame data) and some control registers for Data Store operations. Once a match is 
found, Ingress frame alterations may include a VLAN header insertion or overlay. This 
alteration is not performed by the interface device processor complex, but rather 
30 hardware flags are derived and other Ingress Switch Interface hardware performs the 
alterations. Other frame alterations can be accomplished by the picocode and the 
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Data Store Coprocessor by modifying the frame contents held in the Ingress Data 
Store. 

Other data are gathered and used to build Switch Headers and Frame Headers 
5 prior to sending frames to the switch fabric device. Control data include switch 
information, such as the destination blade of the frame, as well as information for the 
Egress Interface device, helping it expedite frame lookup of destination ports, 
multicast or unicast operations, and Egress Frame alterations. 

10 Upon completion, the Enqueue Coprocessor builds the necessary formats for 

enqueuing the frame to the switch fabric and sends them to the Completion Unit. The 
Completion Unit guarantees frame order from the ten protocol processors to the 
switch fabric queues. Frames from the switch fabric queues are segmented into 64 
byte cells with Frame Header bytes and Switch Header bytes inserted as they are 

15 transmitted to the Prizma-E Switch. 

Frames received from the switch fabric are placed in Egress Data Store 
(Egress DS) buffers by an Egress EDS (34) and enqueued to the EPC. A portion of 
the frame is sent by the dispatcher to an idle protocol processor for performing frame 
20 lookups. Frame data are dispatched to the protocol processor along with data from 
the Classifier Hardware Assist. The Classifier Hardware Assist uses frame control 
data created by the Ingress Interface device to help determine the beginning Code 
Instruction Address (CIA). 

25 Egress Tree Searches support the same algorithms as supported for Ingress 

Searches. Lookup is performed with the TSE Coprocessor, freeing the protocol 
processor to continue execution. All Control memory operations are managed by the 
Control memory Arbiter, which allocates memory access among the ten processor 
complexes. 

30 

Egress frame data are accessed through the Data Store Coprocessor. The 
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Data Store Coprocessor contains a primary data buffer (holding up to eight 16-byte 
segments of frame data), a scratch pad data buffer (also holding up to eight 16-byte 
segments of frame data) and some control registers for Data Store operations. The 
result of a successful lookup contains forwarding information and, in some cases, 
5 frame alteration information. Frame alterations can include VLAN header deletion, 
Time to Live increment (IPX) or decrement (IP), IP Header Checksum recalculation, 
Ethernet frame CRC overlay or insertion and MAC DA/SA overlay or insertion. IP 
Header checksums are prepared by the Checksum Coprocessor. Alterations are not 
performed by the Interface device Processor Complex, but rather hardware flags are 
10 created and PMM Egress hardware performs the alterations. Upon completion, the 
Enqueue Coprocessor is used to help build the necessary formats for enqueuing the 
frame in the EDS Egress queues and sending them to the Completion Unit. The 
Completion Unit guarantees frame order from the ten protocol processors to the EDS 
Egress queues feeding the egress Ethernet MACs 36. 

15 

The completed frames are finally sent by PMM Egress hardware to the 
Ethernet MACs and out the Ethernet ports. 

An internal bus, referred to as the Web, allows access to internal registers, 
20 counters and memory. The Web also includes an external interface to control 
instruction step and interrupt control for debugging and diagnostics. 

Tree Search Engine coprocessor provides memory range checking, illegal 
memory access notification and performs tree search instructions (such as memory 
25 read, write or read-add-write) operating in parallel with protocol processor execution. 

Common Instruction Memory consists of one 1024x128 RAM and two sets of 
Dual 512x128 RAM. Each set of Dual RAMs provides two copies of the same 
picocode, allowing processors independent access to instructions within the same 
30 address range. Each 128-bit word includes four 32-bit instructions, providing a total 
range of 81 92 instructions. 
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The Dispatcher controls the passing of frames to the ten protocol processors 
and manages interrupts and timers. 

The Completion Unit guarantees frame order from the processor complex to 
5 the switch fabric and target port queues. A rich instruction set includes conditional 
execution, packing (for input hash keys), conditional branching, signed and unsigned 
operations, counts of leading zeros and more. 

The Classifier Hardware Assist engine parses each frame's layer 2 and layer 
10 3 protocol header and provides this information with frames as they are dispatched 
to the protocol processors. 



The Control memory Arbiter controls processor access to both internal and 
external memory. 

15 

External Control memory options include 5 to 7 DDR DRAM subsystems each 
supporting a pair of 2M x 16 bit x 4 bank or a pair of 4M x 16 bit x 4 bank DDR 
DRAMs. The DDR DRAM interface runs at a 133 MHZ clock rate and a 266 MHZ data 
strobe supporting configurable CAS latency and drive strength. An optional 133 MHZ 
20 ZBT SRAM can be added in either a 128Kx36, 2x256Kx18 or 2x512Kx18 
configuration. 



Egress frames may be stored in either one External Data Buffer (e.g. DSO) or 
two External Data Buffers (DSO and DS1). Each Buffer can be comprised of a pair of 

25 2M x 1 6 bit x 4 bank DDR DRAM (storing up to 256K 64-byte frames) or a pair of 4M 
x 16 bit x 4 bank DDR DRAM (storing up to 51 2K 64-byte frames). Choose the single 
External Data Buffer (e.g. DSO) for 2.28 Mbps or add the second Buffer (e.g. DS1) to 
support 4.57 Mbps layer 2 and layer 3 switching. Adding the second Buffer improves 
performance, but it does not increase frame capacity. The External Data Buffer 

30 interface runs at a 133 MHZ clock rate with a 266 MHZ data strobe and supports 
configurable CAS latency and drive strength. 
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Internal Control memory includes two 512 x 128 bit RAMs, two 1024 x 36 bit 
RAMs and one 1024 x 64 bit RAM. 

Internal Data storage provides buffering for up to 2048 64-byte frames in the 
5 Ingress direction (UP). 

Fixed Frame alterations include VLAN tag insertions in the Ingress direction 
and VLAN tag deletions, Time To Live increment/decrement (IP, IPx), Ethernet CRC 
overlay/insert and MAC DA/SA overlay/insert in the Egress (DOWN) direction. 



Port mirroring allows one receive port and one transmit port to be copied to a 
system designated observation port without using protocol processor resources. 
Mirrored Interface device ports are configured to add frame and switch control data. 
A separate data path allows direct frame enqueuing to the Ingress Switch interface. 

15 

The interface device integrates four Ethernet macros. Each macro can be 
individually configured to operate in either 1 Gigabit or 10/100 Fast Ethernet modes. 
Each Ethernet macro supports up to ten 1 0/1 00 Mbps MACs or one 1 000 Mbps MACs 
for each of four macros. 

20 

Figure 1 A shows a block diagram of the MAC core. Each macro includes three 
Ethernet Core designs; to wit, the multiport 1 0/1 00 Mbps MAC Core (Fenet), the 1 000 
Mbps MAC core (Genet) and the 100 Mbps Physical Coding Sublayer Core (PCS). 

25 Multi-Port Ethernet 10/100 MAC Features: 

Supports ten Serial Medium Independent Interfaces to the physical layer 

Capable of handling ten ports of 10 Mbps or 100 Mbps media speeds, any 
30 speed mix 
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A single MAC services all ten ports with a Time Division Multiplex interface 

Supports Full/Half duplex operations at media speed on all ports 

5 Supports IEEE 802.3 Binary Exponential Backoff 

1000 Mbps Ethernet MAC Core Features: 

Supports Gigabit Medium Independent interface (GMII) to the physical PCS 
1 0 layer or directly to the physical layer 

With the PCS Core, supports a complete TBI (8b/10b) solution 

Supports Full duplex Point-to-Point connections at media speed 

15 

Supports the IBM PCS Core valid byte signalling 

1000 Mbps Ethernet Physical Coding Sublayer Core Features: 

20 Performs 8b/10b encoding and decoding 

Supports the PMA (10 bit) Service Interface as defined in IEEE 802.3z, this 
interface attaches to any PMA that is compliant with IEEE 802.3z 

25 Synchronizes data received from the PMA (two phase clock) with the MAC 

(single phase) clock 

Supports Auto-Negotiation including two next pages 

30 Converts from a two phase clock system defined in the standards to a single 

phase clock 
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Provides a signal to the MAC indicating those clock cycles that contain new 

data 

Checks the received code groups (1 0 bits) for COMMA'S and establishes word 

5 sync 

Calculates and checks the 8b/10b running disparity 

Figures 2A - 2D show different configurations for the Interface device Chip. 
1 0 The configurations are facilitated by DASL and connection to a switching fabric device. 
Each DASL includes two channels; namely, a transmit channel and a receiver 
channel. 

Figure 2A shows a wrap configuration for a single Interface device. In this 
15 configuration, the transmit channel is wrapped to the receive channel. 

Figure 2B shows the configuration in which two Interface device chips are 
connected. Each Interface device chip is provided with at least two DASLs. In this 
configuration, the channels on one DASL on one chip are operatively connected to the 
20 channels of a matching DASL on the other chip. The other DASL on each chip is 
wrapped. 

Figure 2C shows the configuration in which multiple Interface devices are 
connected to a switch fabric. The double headed arrows indicate transmission in both 
25 directions. 

Figure 2D shows the configuration in which a Main switch and a Backup switch 
are connected to Multiple Interface devices. If the main switch goes down, the backup 
is available for use. 

30 

A Control Point (CP) includes a System Processor that is connected to each 
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of the configuration. The system processor at the CP, among other things, provides 
initialization and configuration services to the chip. The CP may be located in any of 
three locations: in the interface device chip; on the blade on which the chip is 
mounted or external to the blade. If external to the blade, the CP may be remote; that 
5 is, housed elsewhere and communicating by the network to which the interface device 
and CP are attached. The elements of a CP are shown in Figure 17 and include 
memory elements (cache, flash and SDRAM), a memory controller, a PCI bus, and 
connectors for a backplane and for L1 network media. 

1 0 Figure 1 8 shows the single chip Network Processor and the functions provided 

by the EDS-UP, the traffic Management (MGT) Scheduler and the EDS-DOWN (DN). 
The U-shaped icons represent queues and the Control Block (CB) that keeps track of 
the contents in the queues are represented by rectangular icons. 

15 A description of the elements, their respective functions and interaction follows. 

PMM: This is the part of the Network Processors that contains the MACs (FEnet, 
POS, GEnet) and attaches to the external PHY devices. 

20 UP-PMM: This logic takes bytes from the PHYs, and formats it into FISH (16 bytes) 
to pass on to the UP-EDS. There are 4 DMUs within the PMM, each capable of 
working with 1 GEnet or 10 FEnet devices. 

UP-EDS: This logic takes the fish from UP-PMM and stores them into the UP-Data 
25 Store (internal RAM). It is capable of working on 40 frames at once, and after the 
appropriate number of bytes are received, it will enqueue the frame to the EPC. 
When the EPC is finished with the frame, the UP-EDS will enqueue the frame into the 
appropriate Target Port Queue and start sending the frame to the UP-SDM. The UP- 
EDS is responsible for all buffer and frame management and returns the 
30 buffers/frames back to free pools when the transfer to UP-SDM is complete. 
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EPC: This logic contains the picoprocessors and may contain an embedded 
PowerPC. This logic is capable of looking at the frame header and deciding what to 
do with the frame (forward, modify, filter, etc.). The EPC has access to several lookup 
tables, and hardware assists to allow the picoprocessors to keep up with the high- 
5 bandwidth requirements of the Network Processor. 

UP-SDM: This logic takes the frames, and formats them into PRIZMA cells for 
transmission to the switch fabric. This logic is also capable of inserting the VLAN 
header into the frame. 

10 

UP-SIF: This logic contains the UP-DASL macros and attaches to the external switch 
l/Os. 

DN-SIF: This logic contains the DN-DASL macros and receives PRIZMA cells from 
15 the external l/Os. 

DN-SDM: This logic receives the PRIZMA cells and preprocesses them for help in 
frame reassembly. 

20 DN-EDS: This logic takes each cell and assembles them back into frames. The cell 
is stored into external Data Store, and buffers are linked together to make frames. 
When the entire frame is received, the frame will be enqueued to the EPC. After EPC 
is finished with the frame, it is enqueued to the Scheduler (if present) or the Target 
Port Queues. DN-EDS then sends the frames to the appropriate port by sending the 

25 frame, any alteration information, and some control information to the DN-PMM. 

DN-PMM: Takes the information from DN-EDS and formats the frame into Ethernet, 
POS, etc. and sends the frame to the external PHY. 

30 SPM: This logic is used to allow the Network Processor to interface to external 
devices (PHYs, LEDs, FLASH, etc) but only requires 3 l/Os. The Network Processor 
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uses a serial interface to communicate to SPM and then SPM preforms the necessary 
functions to manage these external devices. 

UP-SIDE Flow 

5 1) Frame arrives at PHY 

2) Bytes are received by UP-PMM 

3) UP-PMM sends FISH over to UP-EDS (Fish means a portion of a frame) 

4) UP-EDS stores FISH into UP-DS 

5) UP-EDS sends header over to EPC 

10 6) EPC processes header and sends enqueue information back to UP-EDS 

7) UP-EDS continues to receive the remainder of frame from UP-PMM 

8) UP-EDS sends information to UP-SDM when appropriate data is ready to send 
to switch 

9) UP-SDM reads frame data and formats it into PRIZMA cells 
15 10) UP-SDM sends cells to UP-SIF 

1 1 ) UP-SIF transfers the cells over the DASL serial links to PRIZMA 

12) UP-EDS frees up buffers/frames when all the data has been taken 

DN-SIDE Flow 
20 1) DN-SIF receives PRIZMA cells 

2) DN-SDM stores cells and preprocesses them for reassembly information 

3) DN-EDS receives the cell data and reassembly information and links the cell 
into a new frame on down side 

4) DN-EDS stores the cell into DN-DS 

25 5) DN-EDS enqueues the frame to EPC when all of the data have been received 

6) EPC processes the header and sends enqueue information back to DN-EDS 

7) DN-EDS enqueues the frame into a scheduler queue (if present) or a Target 
Port Queue 

8) DN-EDS services the queues and sends frame information into the PCB 

30 9) DN-EDS uses the PCB to "unravel" the frame and reads the appropriate data 
and sends that data to DN-PMM 
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10) DN-PMM formats the data (with alteration if requested) and sends the frame 
to the external PHY 

11) DN-PMM informs DN-EDS when buffers are no longer needed and DN-EDS 
frees these resources 

5 

FRAME Control Flow 

1 ) Header is sent to EPC from UP-DS or DN-DS 

2) EPC looks up header information in lookup tables and receives frame enqueue 
information 

10 3) EPC sends the enqueue information back to the EDS and the frame is 
enqueued to the appropriate queue 
4) Cell Headers and Frame Headers are sent along with the frame data to aid in 
reassembly and frame forwarding 

15 CP Control Flow 

1 ) Control Point formats a Guided Frame and sends it to the Network Processor 

2) The Network Processor enqueues the Guided Frame to the GCH 
picoprocessor 

3) The GCH processes the Guided Frame and reads or writes the requested 
20 areas of Rainier 

4) The GCH passes any Table update requests over to the GTH 

5) The GTH updates the appropriate table with information from Guided Frame 

6) An acknowledgement Guided Frame is sent back to CP 

25 Network Processor Control Flow 

1) A Picoprocessor can build a Guided Frame to send information to another 
Rainier or the Control Point 

2) The Guided Frame is sent to the appropriate location for processing 



30 
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A single Interface device provides media speed switching for up to 40 Fast 
Ethernet Ports (Figure 2A). 80 Fast Ethernet Ports are supported when two Interface 
devices are interconnected using IBM's Data Aligned Synchronous Link (DASL) 
technology (Figure 2B). Each DASL differential pair carries 440 Mbps of data. Two 
5 sets of eight pairs provide a 3.5 Gbps duplex connection (8 times 440 Mbps in each 
direction). As shown in Figures 2C and 2D, larger systems can be built by 
interconnecting multiple Interface devices to a switch such as IBM's Prizma-E switch. 
The Interface device provides two of the 3.5 Gbps duplex DASL connections, one 
primary and one secondary, which can be used to provide a wrap-backpath for local 
10 frame traffic (when two Interface devices are directly connected, Figure 2B) or a 
connection to a redundant switch fabric (Figure 2D, Backup Sw.). In view of the 
above, the single Network Processor Chip is scaleable in that one chip can be used 
to provide a low end system (having relatively low port density - say 40) to high end 
system (having relatively high port density, say 80 - n ports). 

15 

One Interface device in the system is connected to the system processor via 
one of up to ten 10/100 Mbps Fast Ethernet ports or a single 1000 Mbps Ethernet 
port. The Ethernet configuration to the system processor is placed in an EEPROM 
attached to the Interface device and loaded during initialization. The system 
20 processor communicates with all Interface devices in a system (see Figure 2) by 
building special Guided Frames encapsulated, for example, as ethernet frames or 
other media interfaces. The encapsulated Guided Frames are forwarded across the 
DASL link to other devices allowing all of the Interface devices in the system to be 
controlled from a single point. 

25 

Guided Frames are used to communicate control information between the 
Control Point (CP) and the Embedded Processor Complex and within the interface 
device. A prior disclosure of Guided Cells which will elucidate the discussion here is 
found in U.S. Pat. 5,724,348 issued 3 March 1998 for Efficient Hardware/Software 
30 Interface for a Data Switch". 
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For Guided Frame traffic that originates at the CP, the CP constructs the 
Guided Frame in data buffers in its local memory. The CP's Device Driver sends the 
Guided Frame to one of the media interfaces of the NetworkProcessor. Media Access 
Control (MAC) hardware recovers the Guided Frame and stores it in its internal data 
5 store (U_DS) memory. The Guided Frame is routed to the appropriate blade, 
processed, and routed back to the CP as required. Guided Frames passing between 
an external CP and the interface device are encapsulated to adapt to the protocol of 
the external network. As a consequence, if the external network includes ethemet, the 
Guided Frames are encapsulated as ethemet frames and so forth. 



Ethernet encapsulation provides a means of transport for Guided Traffic 
between the CP and the Interface device. The Ethernet MAC (Enet MAC) of the 
Interface device does not analyze the Destination Address (DA) or Source Address 
(SA) when receiving frames. This analysis is performed by the EPC picocode. 

15 Guided Traffic presumes that the Interface device has not been configured and the 
DA and SA cannot be analysed by the EPC picocode. Therefore, these frames are 
inherently self-routing. The Enet MAC does, however, analyse the Ethernet Type field 
to distinguish Guided Traffic from Data Traffic. The value of this Ethernet Type value 
of the Guided Frame must match the value loaded into the E_Type_C Register. This 

20 register is loaded from Flash Memory by the Interface device's boot picocode. 

The CP constructs the Guided Frame in data buffers in its local memory. The 
contents of a 32 bit register in the CP processor are stored in big endian format in the 
local memory as shown in Figure 3. Having constructed the Guided Frame, the CP'S 

25 Device Driver sends an Ethernet frame containing a DA for specific Guided Cell 
Handler (GCH), an SA corresponding to the global MAC address for the CP or the 
MAC address for specific interface, a special Ethernet Type field that indicates a 
Guided Frame, and the Guided Frame Data. All Ethernet frames arriving on the port 
are received and analyzed by Enet MAC. For frames with an Ethernet Type value 

30 matching the contents of the E_Type_C Register, the Enet MAC strips off the DA, SA 
and Ethernet Type fields and stores the Guided Frame data into the U_DS memory. 
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Bytes are collected by the Enet MAC one at a time into a block of 16 bytes called a 
Fish. These bytes are stored in big endian format with the first byte of the Guided 
Frame stored in the most significant byte location of the Fish (Byte 0). Succeeding 
bytes are stored in successive byte locations within the Fish (Byte 1 , Byte 2, .... Byte 
5 15). These 16 bytes are then stored in a Buffer in the U_DS beginning at the Fish 0 
location. Succeeding Fishes are stored in successive Fish locations within the Buffer 
(Fish 1 , Fish 2, Fish 3, etc.). Additional Buffers are obtained from a free pool as 
required to store the remainder of the Guided Frame. 

10 The flow of guided traffic within the interface device 10 is shown in Figure 4. 

The Enet MAC function of the Interface device examines the frame header information 
and determines that the frame is a Guided Frame. The Enet MAC removes the frame 
header from the Guided Frame and buffers the remainder of its contents in Interface 
device's internal U_DS memory. The Enet MAC indicates that the frame is to be 

1 5 enqueued to the General Control (GC) Queue for processing by the GCH. When the 
end of the Guided Frame has been reached, the Enqueue, Dequeue, and Schedule 
(EDS) logic enqueues the frame into the GC Queue. 

The GCH picocode on the blade locally attached to the CP examines the 
20 Frame Control Information (see Figure 6) to determine whether the Guided Frame is 
intended for other blades in the system and whether the Guided Frame is to be 
executed on the down side of the Interface device. If the frame is intended for blades 
other than or in addition to the locally attached blade, the GCH picocode updates the 
TB value in the Frame Control Block (FCB) with the TB value from the Guided 
25 Frame's Frame Control information and instructs the EDS to enqueue the frame in the 
multicast Target Blade Start of Frame (TB_SOF) Queue. For performance reasons, 
all Guided Traffic is enqueued to the multicast TB_SOF queue independent of the 
number of destination blades indicated. 

30 If the frame is intended for only the locally attached blade, the GCH picocode 

examines the up/down field of the Frame Control information to determine whether the 
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Guided Frame is to be executed on the up or down side of the Interface device (see 
Figure 6). If the Guided Frame is to be executed on the down side of the Interface 
device, the GCH picocode updates the TB value in the FCB with the TB value from 
the Guided Frame's Frame Control information and instructs the EDS to enqueue the 
5 frame in the multicast Target Blade Start of Frame (TB_SOF) Queue. If the Frame 
Control information indicates that the Guided Frame is to be executed on the up side, 
the GCH picocode analyzes the Guided Frame and performs the operations indicated 
by the Guided Commands it contains. 

10 Prior to processing of Guided Commands, the picocode checks the value of the 

ack/noack" field of the Frame Control information. If this value is '0'b, then the Guided 
Frame is discarded following processing. Guided read commands shall not be of this 
category. 

1 5 If the value of the ack/noack field is ' 1 'b, and the value of the early/late field is 

Tb, then prior to processing any of the Guided Commands in the Guided Frame, the 
picocode constructs an Early Ack Guided Frame with the value of the TB field of the 
Frame Control equal to the contents of the Early_Ack Guided Frame with the value 
of the TB field of the Frame Control equal to the contents of the My_TB Register. The 

20 picocode routes the Early Ack Guided Frame back to the CP by updating the TB value 
in the frame's FCB with the value contained in the TB field of the LAN Control Point 
Address (LAN_CP_Addr) Register and instructing the EDS to enqueue the frame in 
the multicast TB_SOF Queue. The picocode then processes the Guided Commands 
of the Guided Frame and discards the Guided Frame. Guided read commands shall 

25 not be of this category. 

If, on the other hand, the value of the ack/noack field is Tb and the value of the 
early/late field is '0'b, the picocode changes the resp/req field of the Frame Control 
information to Tb to indicate a Guided Frame response, replaces the TB field with the 
30 contents of the My_TB Register, and processes each Guided Command within the 
Guided Frame. During the course of processing a Guided Command, the picocode 
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updates the Completion Code field of the next Guided Command with the completion 
status code value for the current Guided Command. The picocode routes the 
response back to the source by updating the TB value in the (FCB) with the value 
corresponding to the Source Blade (LAN_CP_Addr Register value for CP) and 
5 instructing the EDS to enqueue the frame in the multicast TB_SOF Queue. 

Frames residing in the TB_SOF Queue are scheduled for forwarding by the 
EDS. The Switch Data Mover (SDM) builds the switching fabric Cell Header and 
Interface device Frame Header from the information contained in the FCB. These 
1 0 cells pass through the switching fabric device and arrive at the target blade where the 
cells are reassembled into a frame in the D-DS memory. The SDM of the down side 
recognizes that the frame is a Guided Frame and signals the EDS to enqueue it in the 
GC Queue. 

15 Pressure from the GC Queue or the GT Queue stimulates the picocode to 

access and analyse the Guided Frames. All Guided Frames arriving on the down side 
are initially enqueued in the GC Queue. The gth/gch value of the Frame Control 
Information for these frames is examined by GCH picocode. If the gth/gch value is 
'0'b, the Guided Frame is enqueued in the GT Queue. Otherwise, the GCH picocode 

20 examines the resp/req field of the Frame Control information to determine if the 
Guided Frame has already been executed. If the resp/req has a value of '1 'b, then the 
Guided Frame has already been executed and is routed to the CP. Target port values 
corresponding to CP connections are maintained by EPC picocode. Frames from 
these Target Port queues are transmitted from the Interface device back to the CP. 

25 

If the resp/req field has a value of '0'b, then the blade may be local or remote 
with respect to the CP. This is resolved by comparing the value of the TB field of the 
LAN_CP_Addr Register with the contents of the My Target Blade (My_TB) Register. 
If they match, then the blade is local to the CP, otherwise, the blade is remote form 
30 the CP. In either case, the picocode examines the up/down value of the Frame 
Control Information. If up/down is equal to Tb, then the frame is enqueued in the 
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Wrap TP queue for forwarding to the U_DS and processing by the GCH on the up 
side. Otherwise, the picocode (GCH or Gth) performs the operations indicted by the 
Guided Commands contained in the Guided Frame. Priorto processing of the Guided 
Commands, the picocode checks the value of the ack/noack field of the Frame Control 
5 information. If this value is '0'b, then the Guided Frame is discarded following 
processing. Guided read commands shall not be of this category. 

If the value of the ack/noack field is Tb and the value of the early/iate field is 
Tb, then priorto processing any of the Guided Commands in the Guided Frame, the 

1 0 picocode constructs an Early Ack Guided Frame with the value of the TB field of the 
Frame Control information equal to the contents of the My_TB Register. If the bade 
is remote from the CP, the picocode routes the Early Ack Guided Frame to the Wrap 
Port. Otherwise, the blade is local to the CP and the frame is routed to the Port Queue 
corresponding to the CP. The picocode processes the Guided Commands while 

1 5 either the Wrap Port moves the Early Ack Guided Frame from the D_DS to the U_DS 
and enqueues the frame in the GC Queue on the up side or the frame is transmitted 
from the Port Queue back to the CP. For frames wrapped back to the U_DS, the GCH 
picocode again sees this frame, but the resp/req field will have a value of Tb. The 
GCH picocode routes the frame back to the CP by updating the TB field in the FCB 

20 with the value contained in the TB field of the LAN_CP_Addr Register and instructing 
the EDS to enqueue the frame in the multicast TB_SOF Queue. Frames residing in 
the TB_SOF Queue are scheduled for forwarding by the EDS. The SDM builds the 
Prizma Cell Header and Interface device Frame header from information contained 
in the FCB. Cells from this frame pass through Prizma and are reassembled into a 

25 frame on the CP's local blade. The SDM of the down side recognizes that the frame 
is a Guided Frame and signals the EDS to enqueue it in the GC Queue. This time 
when the GCH picocode analyzes the frame, the resp/req field has a value of Tb. 
This implies that this blade is locally attached to the CP and the Guided Frame is 
routed to the Port Queue corresponding to the CP. Frames from this queue are 

30 transmitted from Interface device back to the CP. 
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If, on the other hand, the value of the ack/noack field is Tb and the value of 
the early/lile field is 'O'b, the picocode changes the resp/req field to Tb to indicate 
a Guided Frame response, replaces the TB field with the contents of the My_TB 
Register, and then processes each Guided Command within the Guided Frame. 
5 During the course of processing a Guided Command, the picocode updates the 
Completion Code field of the next Guided Command with the completion status code 
value for the current Guided Command. If the blade is remote from the CP, then the 
picocode routes the Guided Frame to the Wrap Port. Otherwise, the blade is local to 
the CP and the frame is routed to the Port Queue corresponding to the CP. Either the 

10 Wrap Port moves the Guided Frame from the D_DS to the U_DS and enqueues the 
frame in the GC Queue on the up side or the frame is transmitted form the Port Queue 
back to the CP. For frames wrapped back to the U_DS, the GCH picocode again sees 
this frame, but the resp/req field will have a value of Tb. The GCH picocode routes 
the frame back to the CP by updating the TB field in the FCB with the value contained 

1 5 in the TB field of the LAN_CP_Addr Register and instructing the EDS to enqueue the 
frame in the multicast TB_SOF Queue. Frames residing in the TB_SOF Queue are 
scheduled for forwarding by the EDS. The SDM builds the Prizma Cell Header and 
Interface device Frame header from information contained in the FCB. Cells from this 
frame pass through Prizma and are reassembled into a frame on the down side of the 

20 CP's local blade. The SDM of the down side recognizes that the frame is a Guided 
Frame and signals the EDS to enqueue it in the GC Queue. This time when the GCH 
picocode analyzes the frame from the D_DS, the resp/req field has a value of Tb. 
This implies that this blade is locally attached to the CP and the Guided Frame is 
routed to the Port Queue corresponding to the CP. Frames from this queue are 

25 transmitted from Interface device back to the CP. 

If, for any reason, the GCH picocode encounters a Guided Frame with the TB 
field of the Frame Control information equal to '0000'h, then the GCH picocode 
interprets the frame as intended for only this blade and act accordingly. This action is 
30 required during initialization when the value of the My_TB Register is 'OOOO'h for all 
blades. The CP will initialize the My_TB Register of the locally attached blade by 
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sending Write Guided Command in a Guided Frame whose Frame Control Information 
has a TB value of '0000'h. 

Any of the picoprocessors within the EPC can generate a Guided Frame. This 
5 frame can be the Unsolicited Guided Frame or any other form of Guided Frame. 
Internally generated frames of this type are constructed in a way that does not allow 
acknowledgment (i.e. ack/noack - 'O'b). These frames may be sent to one of the two 
picoprocessors (GCH or GTH) within the same EPC or to the GCH or GTH of some 
other blade. 

10 

Unsolicited Guided Frames may also be sent to the CP. Guided Frames 
destined for the same EPC are constructed using data buffers in the D_DS. These 
frames are then enqueued in the GC or GT Queue for processing. These frames are 
then processed and discarded in the usual manner. Unsolicited Guided Frames 
1 5 destined for the locally attached CP are constructed using data buffers in the D_DS. 
These frames are constructed in a way that indicates that they have been executed 
by the EPC (i.e. resp/req = ' 1 'b, and TB = My_TB). These frames are enqueued in the 
Port Queue corresponding to the CP. Frames from this queue are transmitted back 
to the CP. 

20 

Guided Frames destined for another blade can be constructed using data 
buffers in the D_DS or the U_DS. Unsolicited Guided Frames destined for the CP are 
constructed in a way that indicates that they have been executed by the EPC (i.e. 
resp/req = Tb, and TB = My_TB). Frames constructed using buffers from the D_DS 

25 are enqueued to the Wrap Port. These frames are moved to the U_DS and enqueued 
to the GC Queue on the up side. Unsolicited Guided Frames with a resp/req value of 
' 1 'b will be routed to the CP using TB value in the LAN_CP_Addr Register. Otherwise, 
the GCH picocode routes these frames using the TB value of the Frame Control 
Information of the Guided Frame. At the receiving blade, the frame is enqueued to the 

30 GC Queue of the down side. The GCH of this blade executes and discard the frame 
(resp/req = '0'b and gth/gch = ' 1 '), or enqueues the frame to the GT Queue (resp/req 
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= "O'b and gth/gcR = *0'), or enqueues the frame to the Port Queue corresponding to 
the CP (resp/req = Tb). Frames constructed using data buffers in the U_DS are 
enqueued directly into the GC Queue of the up side. From this point forward, these 
frames follow the same route and are handled in the same way as those constructed 
5 using D_DS data Buffers. Fig. 5 shows the generalized format for guided frames. 

The format shown is a logical representation with the most significant byte on 
the left and the least significant byte on the right. Four byte words begin with word 0 
at the top and increase towards the bottom of the page. ' 

10 

Since Guided Frames must be routed and processed before the interface 
device has been configured by the CP, these frames must be self-routing. The results 
normally obtained by look-up and classification are contained in this Frame Control 
information field of the Guided Frame allowing the chip to update the FCB with this 

15 information without performing a look-up operation. The target blade information 
contained in the Guided Frame is used by the Guided Frame Handler to prepare the 
Leaf Page field of the FCB. The CP provides the Target Blade information while the 
GCH picocode fills in the other fields in the FCB. This FCB information is used by the 
SDM to prepare the Cell and Frame headers. The format of the Frame Control 

20 information field of the Guided Frame is shown in Figure 6. 

An explanation for the abbreviation at each bit position in Figure 6 follows: 

resp/req Response and Not Request indicator value. This field is used to 
25 differentiate between request (unprocessed) and response Guided 

Frames. 

0 request 

1 response 

30 ack/noack Acknowledgment or No Acknowledgment control value. This field is use 
to control whether (ack) or not (noack) the GCH picocode acknowledges 
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the Guided Frame. Guided Frames that are not to be acknowledged 
shall not contain any form of Guided Command that performs a read. 

0 No Acknowledgment 

1 Acknowledgment 

5 

early/lite Early and Late Acknowledgment control value. This field is used to 
control whether the acknowledgment requested (ack/noack = *1'b) 
occurs before (early) or after (late) the Guided Frame has been 
processed. This field is ignored when ack/noack = 'O'b. 
10 0 Acknowledge after Guided Frame processing 

1 Acknowledge before Guided Frame processing 



neg/alT Negative Acknowledgment or Acknowledge All control value. This field 
is ignored when the ack/noack field has a value of O'b unless a guided 
1 5 command does not complete successfully. 

0 Acknowledge all Guided Frames if ack/noack = * 1 'b. Early or Late 
Acknowledgment determined by value of early/late. 

1 Acknowledge only Guided Frames that do not complete 
successfully. This acknowledgment will occur independent of the 

20 values of ack/noack and early/late and will of course be a late 

acknowledgment. 

up/down Up or Down control value. This value is used to control whether the 
frame is processed on the up side or the down side. This field is ignored 
25 when resp/req is *1'b. All multicast Guided Frames shall have an 

up/down value of '0'b. In addition, Guided Commands that require the 
use of GTH hardware assist instructions shall have an up/down value 
of'O'b. 



30 0 Down side processing 

1 Up side processing 
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gth/gch* General Tree Handler or Guided Cell Handler control value. This value 
is used to direct Guided Frames to the proper picoprocessor. 

0 GCH picoprocessor 

1 GTH picoprocessor 

5 

TB Target Blade value. When resp/req is TJ'b, this field contains routing 

information used by Prizma. Each bit position corresponds to a Target 
Blade. If this value is '0000'h, then the Guided Frame is assumed to be 
for this blade and is executed accordingly. A value of "Tb in one or 
1 0 more bit positions of the TB field indicates that the cell is routed to the 

corresponding Target Blade(s). When resp/req is ' 1 'b, the field contains 
the My_TB value of the responding blade. 

Word 1 of the Guided Frame contains a correlator value (Figure 7). This value 
15 is assigned by the CP software to correlate Guided Frame responses with their 
requests. The Correlator includes a plurality of bits with assigned functions. 

Every Guided Command begins with a Command Control Information field. 
This Command Control contains information that aids the GCH picocode in processing 
20 a Guided Frame. The format for this information is shown in Figure 8. 

Length value: This value indicates the total number of 32 bit words contained 
in the Control Information (Cmd Word 0), The Address Information (Cmd Word 1), and 
Operand (Cmd Words 2+) portions of the Guided Frame. 

25 

Completion Code value: This field is initialized by the CP and is modified by 
the GCH picocode when processing Guided Commands. The GCH picocode uses 
this field for completion status for the preceding Guided Command in the command 
list. Since all Guided Command lists terminate with the End Delimiter Guided 
30 Command, the completion status of the last command is contained in the End 
Delimiter's Completion Code field. 



fopi rl from KM !(i !<S4 on (Hi/2 1/2W 



PCT/US00/20795 



34 



Guided Command type value (Symbolic Name) 



Symbolic Name 



Type 
Value 



Type Description 



End_Delimiter 

Build_TSE_Free_List 
Software_Action 
10 Unsolicited 
Block_Write 

Duplicate_Write 

15 Read 
register 

lnsert_Leaf 
Update_Leaf 
20 Read_Leaf 
Leaf 

Delete_Leaf 

25 



0000 mark the end of a Guided Frame 
sequence 

0001 build a free list. 

001 0 execute software action 

001 1 frames initiated by the EPC picocode 

0100 write a block of data to consecutive 
addresses 

0101 write duplicate data to registers or 
memory. 

0110 request and respond for reading 

or memory data 

0111 reserved 

1000 insert a leaf into the search tree. 

1 001 update a leaf of the search tree 

1010 request and respond for reading of 
Page data 

1011 reserved 

1 1 00 delete a leaf of the search tree 

1101-1111 reserved 



30 



The addressing information contained in the Guided Frame identifies an 
element within the Networking Processor's addressing scheme. The general form for 
the Address Information field is shown in Figure 9. 

The Interface device employs a 32 bit addressing scheme. This addressing 
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scheme assigns an address value to every accessible structure of the Interface 
device. These structures are either internal to the Processor or connected to 
interfaces under the control of the Processor. Some of these structures are accessed 
by the Embedded Processor Complex (EPC) via an internal interface called the Web 
5 Interface. The remainder of the structures are accessed via memory controller 
interfaces. In all cases the general form of the address is shown in Figure 10. 



The Network Controller is subdivided into major chip islands. Each island is 
given a unique Island ID value. This 5 bit Island ID value forms the 5 most significant 

1 0 bits of the address for structures controlled by that chip island. The correspondence 
between encoded Island ID value and the chip island name is shown in Figure 1 1 . The 
second portion of the Web address consists of the next most significant 23 bits. This 
address field is segmented into a structure address portion and an element address 
portion. The number of bits used for each segment may vary from island to island. 

1 5 Some islands may contain only a few large structures while others may contain many 
small structures. For that reason there is no fixed size for these address segments. 
The structure address portion is used to address an array within the island while the 
element address portion is used to address an element within the array. The 
remaining portion of the address is to accommodate the Web Interface's 32 bit data 

20 bus limitation. This 4 bit word address is used for selecting 32 bit segments of the 
addressed element. This is necessary for moving structure elements wider than 32 
bits across the Network Controller's Web Data Bus. Word address value '0'h refers 
to the 32 most significant bits of the structure element while sequential word address 
values correspond to successively less significant segments of the structure element. 

25 The word address portion of the address is not required for structures not accessed 
via the Web Interface. For this reason, the Up Data Store, Control Memories, and 
Down Data Store make use of the entire 27 least significant bits of address to access 
structure elements. Another exception to this format is the address for the SPM 
Interface. In that case all 27 bits of address are used and no element is greater than 

30 32 bits in width. 
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The Embedded Processing Complex (EPC) provides and controls the 
programmability of the Interface device Chip. It includes the following components 
(see also Figure 12A): 

5 N processing units, called GxH: The GxHs concurrently execute picocode that 

is stored in a common Instruction Memory. Each GxH consist of a Processing Unit 
core, called CLP, which contains a 3-stage pipeline, 16 GPRs and an ALU. Each GxH 
also contains several coprocessors, like for example the Tree Search Engine. 

10 Instruction Memory: Is loaded during initialization and contain the pico-code 

for forwarding frames and managing the system. 

A Dispatcher: Dequeues frame-addresses from the up and down dispatcher 
queues. After dequeue, the dispatcher pre-fetches part of the frame-header from the 
15 up or down DataStore (DS) and stores this in an internal memory. As soon as a GxH 
becomes idle, the Dispatcher passes the frame header with appropriate control 
information, like the Code Instruction Address (CIA) to the GxH. The dispatcher also 
handles timers and interrupts. 

20 A Tree Search Memory (TSM) Arbiter: There are a number of shared internal 

and external memory locations available to each GxH. Since this memory is shared 
an arbiter is used to control access to the memory. The TSM can be accessed 
directly by the picocode, which can for example be used to store aging tables in the 
TSM. Also, the TSM will be accessed by the TSE during tree searches. 

25 

The Completion Unit (CU): The Completion Unit performs two functions. First, 
it interfaces the N Processing Units to the UP and Dn EDS (Enqueue, Dequeue and 
Schedule Island). The EDS performs the enqueue action: a frame address, together 
with appropriate parameters called the FCBPage, is queued in either a transmission 
30 queue, a discard queue, or a dispatcher queue. Second, the Completion Unit 
guarantees frame sequence. Since it may happen that multiple GxHs are processing 
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frames that belong to same flow, precautions must be taken that these frames are 
enqueued in the up or dn transmission queues in the right order. The Completion Unit 
uses a label that is generated by the Classifier Hardware Assist upon frame dispatch. 

5 Classifier Hardware Assist: For up-frames, the Classifier Hardware Assist 

provides a classification for well known cases of frame formats. Classification results 
are passed to the GxH, during frame dispatch, in terms of the CIA and contents of one 
or more registers. For dn-frames, the Classifier Hardware Assist determines the CIA, 
depending on the frame header. For both up and dn frame dispatches, the Classifier 
10 Hardware Assist generates a label that is used by the Completion Unit to maintain 
frame sequence. 



Up and dn DataStore Interface and arbiter: Each GxH has access to the up 
and dn DataStore: read access is provided when reading "more Fish" and write access 
15 is provided when writing back the contents of the FishPool to the DataStore. Since 
there are N Processing Units, and only one of them at a time can access the up 
DataStore and one at a time can access the dn DataStore, one arbiter for each 
DataStore is required. 

20 WEB Arbiter and WEBWatch interface: The WEB Arbiter arbitrates among the 

GxHs for access to the WEB. All GxHs have access to the WEB, which allows 
access all memory and registers functions in an Interface device. This allows any 
GxH to modify or read all configuration areas. The WEB can be thought of as the 
Interface device memory map. The WEBWatch interface provides access to the 

25 entire WEB from outside the chip using 3 chip-IO pins. 

Debug, Interrupts and Single Step Control: The WEB allows the GCH or 
WEBWatch to control each GxH on the chip when necessary. For example, the WEB 
can be used by the GCH or WEBWatch to single step instructions on a GxH. 

30 

An embedded general purpose processor, like a PowerPC. 
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There are four types of GxH (Figure 12B): 

GDH (General Data Handler). There are eight GDHs. Each GDH has a full 
CLP with the five coprocessors (which are described in the next section). The GDHs 
5 are mainly used for forwarding frames. 

GCH (Guided Cell Handler). The GCH has exactly the same hardware as a 
GDH. However, a guided frame can only be processed by the GCH. It is 
programmable on the WEB (CLP_Ena register) if the GCH is enabled to also process 

10 dataframes (in which case it takes the role of a GDH). The GCH has additional 
hardware compared to the GDH: hardware assist to perform tree inserts and deletes. 
The GCH is used to execute guided-cell related picocode, perform chip and tree 
management related picocode like aging and to exchange control information with the 
CP and/or another GCH. When there is no such task to perform the GCH will execute 

1 5 frame forwarding related picocode, and in this case behaves exactly like a GDH. 

GTH (General Tree Handler). The GTH has additional hardware assist to 
perform tree inserts, tree deletes and rope management. The GTH will process 
dataframes when there are no frames (containing tree management commands) in the 
20 GPQ. 

GPH (General PowerPC Handler). The GPH has additional hardware as 
coompared with the GDH and GTH. The GPH interfaces to the General Purpose 
Processor through a Mailbox interface (iff). 

25 

The number of GxHs (ten) is a "best-guess". Performance evaluation will 
determine how much GxH are really required. The architecture and structure is 
completely scaleable towards more GxH and the only limitation is the amount of 
silicon area (which should then also include a larger arbiter and instruction memory). 

30 

Each GxH is structured as shown in Figure 12C. In addition to the CLP with 
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General Purpose Registers (GPR) and Arithmetic Logic Unit (ALU), each GxH 
contains the following five coprocessors: 

(DS) Coprocessor Interface. Interfaces to the Dispatcher and to the sub- 
5 islands that provide read and write access to the up and dn DataStores. The DS 
Interface contains the so called FishPool. 

The Tree Search Engine Coprocessor (TSE). The TSE performs searches in 
the trees, and also interfaces to the Tree Search Memory (TSM). 

10 

Enqueue Coprocessor. Interfaces the Completion Unit Interface and contains 
the FCBPage. This Coprocessor contains a 256-bit register with additional hardware 
assist that the picocode must use to build the FCBPage, which contain the enqueue 
parameters. Once the FCBPage is built, the picoprocessor can execute an enqueue 
1 5 instruction, which causes this coprocessor to forward the FCBPage to the Completion 
Unit. 

WEB InterfaceCoprocessor. This coprocessor provides an interface to the 
WEB Arbiter and allows reading and writing to/from the Interface device WEB. 

20 

Checksum Coprocessor. Generates checksums on frames stored in the 
Fishpool (described hereinafter). 

The Processing Units are shared between ingress processing and egress 
25 processing. It is programmable how much bandwidth is reserved for ingress 
processing versus egress processing. In the current implementation, there are two 
modes: 50/50 (i.e. ingress and egress get the same bandwidth) or 66/34 (i.e. ingress 
gets twice as much bandwidth as egress). 

30 Operation of the Processing Units is event-driven. That is, frame arrival is 

treated as an event, as well as popping of a timer or an interrupt. The dispatcher 
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treats different events in an identical fashion, though there is a priority (first interrupt, 
then timer-events and finally frame arrival events). When an event is handed to a 
Processing Unit, appropriate information is given to the Processing Unit. For frame 
arrival events, this includes part of the frame header, and information coming from the 
5 hardware classifier. For timer and interrupts, this includes the code entry point and 
other information that relates to the event. 

When a frame arrives on the ingress side, and the number of received bytes 
of this frame has exceeded a programmable threshold, the address of the frame- 
10 control-block is written in a GQ. 

When a complete frame has been re-assembled on the egress side, the frame 
address is written in a GQ. There are four types of GQ's (and for each type, Figure 
12B, there is an ingress version and a egress version): 

15 

GCQ: contains frames that must be processed by the GCH. 

GTQ: contains frames that must be processed by the GTH. 

20 GPQ: contains frames that must be processed by the GPH. 

GDQ: contains frames that can be processed by any GDH (or GCH / GTH 
when they are enabled to process dataframes). For the GDQ, there are multiple 
priorities, whereby frames enqueued in a higher priority GDQ will be processed before 
25 frames enqueued in a lower priority queue. 

Some Processing Units may be specialized. In the current implementation, 
there are four types of Processing Units (GxH) (see also Figure 12B): 

30 GDH (General Data Handler). The GDHs are mainly used for forwarding 

frames. 



Cupii rl from KM !,S4 on (Hi/2 1/2W 



WO 01/16763 



41 



PCT/US00/20795 



GCH (Guided Cell Handler). The GCH has exactly the same hardware as 
GDH. However, a guided frame can only be processed by the GCH. It is 
programmable on the WEB (CLP_Ena register) if the GCH is enabled to also process 
dataframes (in which case it takes the role of a GDH). 

5 

GTH (General Tree Handler). The GTH has additional hardware compared to 
the GDH/GCH: hardware assist to perform tree inserts, tree deletes and rope 
management. The GTH will process dataframes when there are no frames 
(containing tree management commands) in the GPQ. 

10 

GPH (General PowerPC Handler). The GPH has additional hardware 
compared to the GDH/GTH. The GPH interfaces to the embedded PowerPC by 
means of a mail-box interface. 

15 In an actual implementation, the role of GCH, GTH and GPH can be 

implemented on a single Processing Unit. For example one implementation could 
have one Processing Unit for GCH and GPH. A similar comment holds for the GCQ, 
GTQ and GPQ. 

20 The purpose of the Datastore Coprocessor is: 

To interface to the Up DataStore, which contains frames that have been 
received from the media, and the Down DataStore, which contains reassembled 
frames received from the Prizma Atlantic switch system. 

25 

The Datastore Coprocessor also receives configuration information during the 
dispatch of a timer event or interrupt. 

The Datastore Coprocessor is able to calculate checksums on frames. 

30 

The Datastore Coprocessor contains a FishPool (that can hold 8 fish), a scratch 



fopi rl from KM !(i !<S4 on (Hi/2 1/2W 



WO 01/16763 PCTAJS00/20795 

42 

memory (that can hold 8 fish) and some control registers to read/write FishPool 
contents from/to the up or down datastore. The FishPool can be seen as some kind 
of work area for the Datastore: instead of reading/writing directly to a Datastore, a 
larger amount of frame data is read from the Datastore into the Fishpool or a larger 
5 amount of data is written from the Fishpool into the Datastore. The unit of transfer 
is a Fish, which equals 16 Bytes. 

The Fishpool can be seen as a memory that can contain 8 fish, that is 8 words 
of 128 bits each. In the CLP processor architecture, the Fishpool is a register array 
10 of 128 bytes. Each byte in the Fishpool has a 7-bit byte address (0 ..127) and access 
is on a 16-bit or 32-bit basis. Like all register arrays, the Fishpool has a circular 
addressing scheme. That is, addressing a word (i.e. four bytes) starting at location 
126 in the Fishpool returns bytes 126, 127, 0 and 1. Furthermore, from a Datastore 
Coprocessor point of view, fish-locations in the Fishpool have a 3-bit fish-address. 

15 

Upon frame dispatch the first N fish of a frame are automatically copied in the 
Fishpool by the Dispatcher. The value of N is programmable in the 
PortConfigMemory. Typically, N equals four for up frame dispatch, 2 for down unicast 
frame dispatch, 4 for down multicast frame dispatch and 0 for interrupts and timers. 

20 

The picocode can read more bytes from a frame, in which case the Datastore 
Coprocessor automatically reads the frame data into the fishpool at the next fish 
address, wrapping automatically to 0 when the boundary of the Fishpool has been 
reached. Also, the picocode can read or write the up/down datastore at an absolute 
25 address. 

The WEB Coprocessor interfaces to the EPC WEB Arbiter. The EPC WEB 
Arbiter Arbitrates among the ten GxH and the WEB Watch to become a master on the 
Interface device WEB interface. This allows all GxH to read and write on the WEB. 

30 

The interface device memory complex provides storage facilities for the 
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Embedded Processing Complex (EPC) Figure 12A. The memory complex includes 
the Tree-Search Memory (TSM) Arbiter and a plurality of on-chip and off-chip 
memories. The memories store tree structures, counters and anything else that the 
pico code requires memory access for. Furthermore, the memories are used to store 
5 data structures that are used by the hardware, like free lists, queue-control-blocks, etc. 
Any memory location which is not allocated for trees or which is not allocated for trees 
or which is not used by the hardware is by default available for pico code use, like 
counters and aging tables. 

1 0 Figure 1 3 shows a more detailed block diagram of the memory complex. The 

tree-search memory (TSM) arbiter provides the communication link between the 
Embedded Processors (GxH) and the memories. The memories include 5 on-chip 
SRAMs, 1 off-chip SRAM, and 7 off-chip DRAMS. The TSM Arbiter includes ten 
Request Control Units (each one connected to one of the Embedded Processor GxH) 

1 5 and 1 3 memory arbiter units, one for each memory. A bus structure interconnects the 
Request Control Units and the arbiter units in such a way that each control unit and 
its connected GxH have access to ail memories. 

The control unit includes necessary hardware to steer data between the 
20 Embedded Processor (GxH) and the arbiters. 

The SRAM arbiter units, among other things, manage the flow of data between 
the Embedded Processor GxH and the on-chip and off-chip SRAMs. 

25 The DRAM Arbiter Units, among other things, manages the flow of data 

between the Embedded Processor (GxH) and the off-chip DRAM devices. 

Each Memory Arbiter contains a "back-door" access, which is typically used by 
other parts of the chip and has highest access priority. 

30 

The DRAM Memories can run in two modes of operation: 
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TDM-mode. Memory access to the four banks in the DDRAM is done 
alternating read-"windows" and write-windows, whereby in a read 
window, access to any of the four banks is read-only and in a write 
window, access to any of the four banks is write only. Using TDM-mode 
5 for multiple DDRAMs allows sharing some control signals between the 

DDRAMs and hence this saves some chip IOs (which is a very scarce 
resource). 



Non-TDM-mode. Memory access to the four banks in the DDRAM can 
10 be a combination of read and write, which must follow some specified 

rules. For example, one can do a read in bank A and a write in bank C 
within an access window. 



The TSM Arbiter allows N Requesters simultaneous access to M 
15 memories. When multiple Requesters want to access the same 

memory, a round-robin arbitration is performed. 

The M memories can have different properties. In our current 
implementation, there are three memory types: internal SRAM, external 
20 SRAM and external DDRAM. 

The M memories and N Requesters are homogeneous: any Requester 
can access any memory. 

25 Some memories are logically divided into multiple sub-memories (like 

four banks in the DDRAM), which can be logically accessed 
simultaneously. 



Part of the M memories are used for control memories containing 
30 internally used data structures, which have a high priority access 

compared to the picoprocessors. This also allows debugging of the 
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chip, since the picoprocessors can read the contents of the control 
memories. 

The arbiter supports read access, write access and read-add-write, 
whereby an N-bit integer is added to the contents of the memory in an 
atomic operation. 

A general address scheme is used to access the M memories, such that 
the physical location of an object in the memory is transparent. 



The concept of trees as used by the Tree Search Engine to store and retrieve 
information. Retrieval, i.e., tree-searches and also inserts and deletes are done based 
on a Key, which is a bit-pattern like, for example, a MAC source address, or the 
concatenation of an IP source address and IP destination address. Information is 
15 stored in a control block called Leaf, which contains at least the Key (as will be seen 
later, the stored bit pattern is actually the hashed Key). A leaf can also contain 
additional information, like aging information, or user information, which can for 
example be forwarding information like target blade and target port numbers. 

20 There are tree types (FM, LPM and SMT) and associated tree type searches, 

namely: fixed match, software managed tree and largest prefix match. An optional 
additional criterium for checking the leaf during a tree search is the VectorMask. 
Roping, aging and a latch are used to increase search performance. 

25 The search algorithm for FM trees is shown in Figure 14. The search algorithm 

operates on input parameters, which include the Key, performs a hash on the Key, 
accesses a Direct Table (DT), walks the tree through Pattern Search Control Blocks 
(PSCBs) and ends up at a Leaf (Figure 14). There are three types of trees, each with 
its own search algorithm, which causes the tree-walk to occur according to different 

30 rules. For example, for Fixed Match (FM) trees, the datastructure is a Patricia Tree. 
When a Leaf has been found, this Leaf is the only possible candidate that can match 
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the input Key. For Software Managed Trees, there can be multiple Leafs that are 
chained in a linked list. In this case, all Leafs in the chain are checked with the input 
Key, until a match has been found or until the chain has been exhausted. A so-called 
"compare at the end" operation, which compares the input Key with the pattern stored 
5 in the Leaf, verifies if the Leaf really matches the input Key. The result of the search 
will be OK when the Leaf has been found and a match has occurred, or KO in all other 
cases. 



10 The input to a search operation consists of the following parameters: 

Key (128 bits). The Key must be built using special picocode instructions 

prior to the search (or insert/delete). There is only one Key register. 
However, after the tree search has started, the Key register can be used 
15 by the picocode to build the key for the next search, concurrently with 

the TSE performing the search. This is because the TSE bashes the 
Key and stores the result in an internal HashedKey register (thus, in 
reality, there are 2 Key registers). 

20 KeyLength (7 bits). This register contains the length of the Key in bits. It is 
automatically updated by hardware during building of the Key. 

LUDef Index (8 bits). This is an index into the LUDefTable, which contains a full 
definition of the tree in which the search occurs. The LUDefTable is 
25 described in detail later. 

TSRNr (1 bit). The search results can be stored either in Tree Search Result 
Area 0 (TSRO) or TSR1 . This is specified by TSRNr. While the TSE is 
searching, the picocode can access the other TSR to analyze the results 
30 of a previous search. 
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Vectorlndex (6 bits). For trees which have the VectorMask enabled (which is 
specified in the LUDefTabie), the Vectorlndex denotes a bit in the 
VectorMask. At the end of the search, the value of this bit is returned 
and can be used by picocode. 

5 

The input Key will be hashed into a HashedKey, as shown in Figure 14. There 
are six fixed hash algorithms available (one "algorithm" performs no hash function). 
It is specified in the LUDefTabie which algorithm will be used. A programmable hash 
function may be used to add flexibility. 

10 

The output of the hash function is always a 128-bit number, which has the 
property that there is a one-to-one correspondence between the original input Key and 
the output of the hash function. As will be explained below, this property minimizes 
the depth of the tree that starts after the Direct Table. 

15 

If colors are enabled for the tree, which is the case in the example of Figure 14, 
the 16-bit color register is inserted in the 128-bit hash function output. The insertion 
occurs directly after the Direct Table. I.e., if the Direct Table contains 2 N entries, then 
the 16-bit color value is inserted at bit position N, as shown in the figure. The output 
20 of the hash function, together with the inserted color value (when enabled), is stored 
in the HashedKey register. 

The hash function is defined such that most entropy in its output resides in the 
highest bits. The N highest bits of the HashedKey register are used to calculate an 
25 index into the Direct Table (DT). 

The search starts with an access into the Direct Table: a DTEntry is read from 
the direct table. The address used to read the DTEntry is calculated from the N 
highest bits of the HashedKey, as well as on tree-properties as defined in the 
30 LUDefTabie. This is explained in detail below. The DTEntry can be seen as the root 
of a tree. The particular tree datastructure that is used depends on the tree-type. At 
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this point it suffices to say that a Patricia Tree datastructure is used for FM trees, and 
extensions to Patricia Trees for LPM and SMT trees. 

An example of the use of an 8 entry DT is shown in Figure 15. It can be seen 
5 that the search time (i.e., the number of PSCBs that must be accessed) can be 
reduced by using a DT. Thus, by increasing the DT size, a trade-off can be made 
between memory usage and search performance. 

As can be seen from Figure 15, a DTEntry can contain the following 
10 information: 

Empty. There are no Leafs attached to this DTEntry. 
A pointer to a Leaf. There is a single Leaf attached to this DTEntry. 
A pointer to a PSCB. There are more than one Leafs attached to this 
1 5 DTEntry. The DTEntry defines the root of a tree. 

The Search Algorithm for a software managed tree and algorithm for generating 
the tree is set forth in US Patent Application Serial No. 09/312,148. 

20 An algorithm termed "Choice Bit Algorithm" uses a certain metric to build a 

binary search tree based upon bits selected from items termed "rules" in a set or 
universe of rules. All our examples are couched in terms of Internet Protocol (IP) 
headers, but a fixed format header of any type could be used instead. 

25 In IP, each Rule pertains to certain Keys which might be built with the following 

subsections: Source Address (SA), Destination Address (DA), Source Port (SP), 
Destination Port (DP), and Protocol (P). These data are respectively 32, 32, 16, 16, 
and 8 bits long and so a Key to be tested consists of 104 bits. The Choice Bit 
Algorithm finds certain of the 1 04 bits which are especially useful. Testing the few bits 

30 in effect eliminates all but one or all but a few rules from possible application. For 
some rules, testing inequalities by means of simple compare operations are also 
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appropriate. The bit tests and compares are logically organized in a binary tree. The 
tree is mapped into a hardware enabled structure that tests bits at high speeds. Such 
testing results in just one rule or a small number of rules (called a leaf chain) which 
the Key might fit. In the former case, the Key is then tested in full by the rule. In the 
5 latter case, the Key is then tested in a lattice of tests using compares and full rule 
tests. 



Each rule in the rule set is associated with an action which is taken if the rule 
is the highest priority rule which fits the key. Rules can intersect (one key fits two or 
10 more rules). In that case, rules can be given priority numbers 1 , 2, 3, so that any 
two intersecting rules have different priorities (an administrator must declare which 
rule dominates if a key fits two or more). Thus if more than one rule remains to be 
tested after the bit tests and compares, the rules are tested in order of priority. A 
lower priority number designates a rule with higher priority. 



If no fit is found at all, some default provision may be specified. 



The search algorithm for the longest Prefix Matching method is set forth in US 
Patent 5,787,430. The method requires entering at a node of said database (root 

20 node); determining a search path from one node to another through said tree-like 
database by successively processing segments of said search argument which 
comprise only those parts of the entries which are necessary to identify the next (child) 
node, and said second link information until said segments are consumed or a (leaf) 
node lacking said second link information is reached; comparing with said search 

25 argument an entry stored in the node at which said search path ended; and if no at 
least partial match between the search argument and said entry is found in said 
current node, backtracking said search path by processing said first link information 
of said current node; and repeating the previous two steps until said at least partial 
match is found or said root node is reached. 

30 

Figure 16 shows an embodiment of the main switching fabric device. 
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Preferably, each interface device chip has at least two integrated parallel-to-serial 
ports which receive parallel data and convert the data to a high speed serial data 
stream which is forwarded over a serial link to the switching fabric device. Data 
received from switching fabric device on a high speed serial link is converted to 
5 parallel data by another DASL. An embodiment of the Serializer/Deserializer termed 
Data Align Serial Link (DASL) is described herein. 

At least one DASL interfaces the switching fabric device to the serial links. 
Data from the serial link is converted into parallel data which is delivered to switching 
1 0 fabric device. Likewise, parallel data from switching fabric device is converted to serial 
data which is delivered to the serial links. The serial links can be aggregated to 
increase throughput. 

Still referring to Figure 16, the switching system includes switch fabric 1 1 , input 
1 5 switch adapters 1 3 (1 3-I . . . 1 3-k) which are connected to the switch fabric input ports 
15 (15-1. . .15-k), and output switch adapters 17 (17-1. . .17-p) which are connected to 
the switch fabric at output ports 19 (19-1. . .19-p). 

Incoming and outgoing transmission links 21 (21-1. . .21-q) and 23 (23-I. . .23-r) 
20 are connected to the switch system by line (link) adapters 25 (25-I. . . 25-q) and 27 
(27-I. . . 27-r), respectively. The transmission links carry circuit switched or packet 
switched traffic from and to attached units such as work stations, telephone sets or the 
like (links designated WS), from and to local area networks (links designated LAN), 
from or to Integrated Services Digital Network facilities (links designated ISDN), or 
25 from and to any other communication systems. Furthermore, processors may be 
attached directly to switch adapters 13 and 17. The line adapters (LA) and switch 
adapters (SA) have a common interface. 

At the input switch adapters, various services from packet switched and circuit 
30 switched interfaces are collected and converted into uniform minipackets (having one 
of several possible fixed lengths), with a header containing routing information 
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designating the required output port (and outgoing link) of the switch. Some details 
on the minipacket format and on minipacket generation in the input switch adapters 
and on depacketization in the output switch adapters will be given in the next sections. 

5 The switch fabric routes the minipackets via a fast self-routing interconnection 

network from any input port to any output port. The structure of the self-routing 
network is such that minipackets can be routed simultaneously internally without any 
conflicts. 

10 The heart of the switching system is the switch fabric. Two different 

implementations are considered and will be described separately. In one 
implementation, the switch fabric comprises a self-routing binary tree for each input 
port, connecting the respective input port to all output ports; the switch fabric 
comprises k such trees in combination (if k input ports are provided). In the other 

15 implementation, a bus structure with an output RAM is provided as a slice for each 
output port, connecting all input ports to the respective output port; the switch fabric 
comprises p such slices in combination (if p output ports are provided). 

DASL is described in United States Application Serial Number 09/330,968, filed 
20 1 1 June 1 999. The DASL Interface receives data from a parallel interface such as a 
CMOS ASIC, partitions the bits from the parallel interface into a smaller number of 
parallel bit streams. The smaller number of parallel bit streams are then converted 
into a high speed serial stream, which is transported via a transmission medium to the 
receiver of the other module. A differential driver with control impedance drives the 
25 serial bit stream of data into the transmission media. 

DASL implements the method of parsing a data stream presented as N bits in 
parallel into a plurality of portions each having n bits, wherein n is a fraction of N; 
serializing each n bit portion of the data stream; transferring each serialized portion 
30 over a corresponding one of a plurality of parallel channels; and deserializing each 
transferred portion of the data stream to restore the data stream to presentation as N 
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bits in parallel. While DASL is employed in certain embodiments described above, it 
is recognised that alternate forms of data transfer can be employed at such points in 
a network processor otherwise embodying the inventions here disclosed. 

In the drawings and specifications there have been set forth preferred 
embodiments of the inventions here disclosed and, although specific terms are used, 
the description thus given uses terminology in a generic and descriptive sense only 
and not for purposes of limitation. 
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1 1. Apparatus comprising: 

2 a control point processor; 

3 an interface device operatively connected to said control point processor by a 

4 control pathway and providing a high speed data pathway, said interface device 

5 having having: 

6 a semiconductor substrate; 

7 a plurality of interface processors formed on said substrate, the number 

8 of said processors being at least five; 

9 internal instruction memory formed on said substrate and storing 

1 0 instructions accessibly to said interface processors; 

1 1 internal data memory formed on said substrate and storing data passing 

12 through said device accessibly to said interface processors; and 

13 a plurality of input/output ports formed on said substrate; 

14 at least one of said input/output ports connecting said internal 

1 5 data memory with external data memory; 

16 at least two other of said input/output ports exchanging data 

1 7 passing through the interface device with an external network at 

1 8 media speed under the direction of said interface processors; 

19 said control point processor cooperating with said interface device by loading 

20 into said instruction memory instructions to be executed by said interface processors 

21 in directing the exchange of data between said data exchange input/output ports and 

22 the flow of data through said data memory. 

1 2. Apparatus according to Claim 1 further comprising: 

2 a second interface device operatively connected to said control point processor 

3 and having: 

4 a semiconductor substrate; 

5 a plurality of interface processors formed on said substrate, the number 

6 of said processors being at least five; 
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7 internal instruction memory formed on said substrate and storing 

8 instructions accessibly to said interface processors; 

9 internal data memory formed on said substrate and storing data passing 

10 through said device accessibly to said interface processors; and 

1 1 a plurality of input/output ports formed on said substrate; 

12 at least one of said input/output ports connecting said internal 

1 3 data memory with external data memory; 

14 at least two other of said input/output ports exchanging data 

15 passing through the interface device with an external network 

16 under the direction of said interface processors; 

17 said control point processor cooperating with said second interface device by 

18 loading into said instruction memory instructions to be executed by said interface 

1 9 processors in directing the exchange of data between said data exchange input/output 

20 ports and the flow of data through said data memory. 

1 3. Apparatus according to Claim 1 further comprising 

2 a second control point processor; 

3 said interface device being operatively connected to one of said control point 

4 processor and said second control point processor; 

5 a second interface device operatively connected to the other of said control 

6 point processor and said second control point processor and having: 

7 a semiconductor substrate; 

8 a plurality of interface processors formed on said substrate, the number 

9 of said processors being at least five; 

10 internal instruction memory formed on said substrate and storing 

1 1 instructions accessibly to said interface processors; 

1 2 internal data memory formed on said substrate and storing data passing 

1 3 through said device accessibly to said interface processors; and 

14 a plurality of input/output ports formed on said substrate; 

15 at least one of said input/output ports connecting said internal 

16 data memory with external data memory; 
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17 at least two other of said input/output ports exchanging data 

18 passing through the interface device with an external network 

19 under the direction of said interface processors; 

20 said other control point processor cooperating with said second interface device 

21 by loading into said instruction memory instructions to be executed by said interface 

22 processors in directing the exchange of data between said data exchange input/output 

23 ports and the flow of data through said data memory. 

1 4. Apparatus according to one of Claims 1 through 3 wherein said control point 

2 processor is located remotely from said interface device and is operatively connected 

3 thereto through said two other input/output ports. 

1 5. Apparatus according to one of Claims 1 through 4 further comprising a printed 

2 circuit board device and wherein circuit elements mounted on said circuit board device 

3 comprise the elements recited in said one of Claims 1 through 4. 

1 6. Apparatus according to Claim 5 further comprising: a self routing switching 

2 fabric device operatively connected to said interface device and directing data 

3 inbound to the apparatus from identifiable addresses to flow outbound from the 

4 apparatus to identified addresses. 

5 7. Apparatus according to one of Claims 1 through 4 further comprising: 

6 a housing; 

7 a backplane mounted in the housing; and 

8 a plurality of printed circuit board devices mounted in said backplane; 

9 and wherein circuit elements on one of said circuit board devices comprise the 
10 elements recited in said one of Claims 1 through 4. 

1 8. Apparatus according to Claim 7 wherein said control point processor is formed 

2 on said semiconductor substrate. 
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1 9. Apparatus according to Claim 7 wherein circuit elements on a second of said 

2 circuit board devices comprise another set of the elements recited in said one of 

3 Claims 1 through 4. 

1 10. A communications device comprising: 

2 a control point processor subsystem; and 

3 a network processor operatively coupled to said control point processor and 

4 having: 

5 a plurality of interface processors; 

6 a plurality of media interfaces; 

7 a plurality of queue registers coupling the media interfaces to the 

8 interface processors and providing queue channels through which data 

9 enters and leaves the interface processors; 

I o memory that stores data passing through said interface processors; and 

I I an euqueue/dequeue scheduler responsive to control signals to move 

12 data from said memory to a selected one of said queue channels; 

13 said control point processor subsystem having a control point function 



14 generator that generates and forwards to one of said plurality of media interfaces a 

15 guided frame with information that allows said control point processor subsystem 

16 access to registers and memories under control of said network processor. 

1 11. The communications device of Claim 1 0 wherein the guided frame information 

2 includes at least one word of frame control information, one word of software 

3 correlation, one guided command and an end delimiter guided command. 

1 12. The communications device of Claim 10 further including a frame control block 

2 register operatively coupled to said interface processors, said frame control block 

3 register storing information used to route a processed guided frame back to the control 

4 point function generator. 

1 13. The communications device of Claim 10 wherein the control point processor 



| 
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8 



6 



7 



4 



2 



5 



3 



subsystem includes 
a bus; 

an arbiter coupled to said bus; 

a CPU coupled to said bus; 

a DMA controller coupled to the bus; 

a Mailbox and DRAM interface coupled to the bus; 

an interrupt controller interconnecting the CPU and the Mailbox and DRAM 



10 



9 



interface; 

a DRAM arbiter coupled to the interface processor and the Mailbox and DRAM 



12 



11 



interface; and 

a DRAM controller coupled to the DRAM arbiter. 



1 14. The communications device of Claim 1 3 further including at least an interrupt 

2 line coupling the control point processor to the Mailbox and DRAM interface and a 

3 communication line interconnecting one of the interface processors to the Mailbox and 

4 DRAM Interface. 

1 1 5. The communications device of Claim 1 0 wherein components of the network 

2 processor are fabricated on a common substrate. 

1 16. The communications device of Claim 15 wherein the control point processor 

2 subsystem is fabricated on the common substrate. 

1 17. The communications device of Claim 10 wherein the control point processor 

2 subsystem is external to a common substrate on which said network processor is 

3 fabricated; and a communications module interconnects the control point processor 

4 subsystem to at least one of the plurality of media interfaces. 

1 18. The communications device of Claim 17 wherein the at least one of the plurality 

2 of media interfaces includes a first ethernet Medium Access Control (MAC) and the 

3 communications module has a second ethernet MAC/PHY coupled to the processor 
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4 sub-system; an ethernet PHY coupled to the ethernet MAC/PHY; and a transmission 

5 media coupling the ethernet PHY to the first ethernet MAC. 

1 19. The communications device of Claim 18 further including an interconnecting 

2 device interconnecting the second ethernet MAC/PHY to the control processor sub- 

3 system; and a storage operatively connected to said interconnecting device. 

1 20. The communications device of Claim 19 wherein the interconnecting device 

2 includes a PCI bridge. 



1 21 . A method comprising the steps of: 

2 storing in an instruction memory instructions for the handling of data transiting 

3 an interface device; 

4 executing in a plurality of interface processors the instructions stored in the 

5 instruction memory; 

6 receiving a data flow inbound through an input port at media speed; 

7 communicating the data flow through the plurality of interface processors; and 

8 directing the data flow outbound through an output port at media speed in 

9 accordance with the execution of the instructions by the interface processors. 

1 22. A method according to Claim 21 further comprising parsing the data flow into 

2 a plurality of portions, storing selected portions of the parsed data flow in data 

3 memory, and directing other selected portions of the parsed data flow to a switching 

4 fabric for determination of an outbound direction. 

1 23. A method according to Claim 22 further comprising recombining the stored and 

2 other selected portions of the data flow prior to direction of the data flow outbound 

3 through an output port. 

1 24. A method according to Claim 21 wherein the step of communicating the data 

2 flow through the plurality of interface processors comprises parsing the data flow into 
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3 portions and distributing the parsed portions among the plurality of interface 

4 processors for handling in parallel. 

5 25. A method comprising the steps of: 

6 using a control point function located in a control point processor to generate 

7 a guided frame; 

8 using a device driver in said control point processor to send the guided frame 

9 to one of a plurality of media interfaces associated with a network processor; 

1 0 using Medium Access Control hardware in said media interfaces to recover the 

1 1 guided frame; 

12 storing the recovered guided frame in a memory; and 

13 routing said stored guided frame to an entity identified in said guided frame. 

1 26. The method of Claim 25 further comprising the steps of processing said guided 

2 frame by said entity according to an instruction carried in said guided frame; and 

3 routing the processed guided frame back to the control point function if required by 

4 information carried in the guided frame. 



1 27. The method of Claim 25 further including the step of encapsulating the guided 

2 frame with network routing information. 
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What is claimed is: 



1 1. Apparatus comprising: 

2 a control point processor; 

3 an interface device operatively connected to said control point processor by a 

4 control pathway and providing a high speed data pathway, said interface device 

5 having having: 

6 a semiconductor substrate; 

7 a plurality of interface processors formed on said substrate, the number 

8 of said processors being at least five; 

9 internal instruction memory formed on said substrate and storing 

10 instructions accessibly to said interface processors; 

1 1 internal data memory formed on said substrate and storing data passing 

12 through said device accessibly to said interface processors; and 

13 a plurality of input/output ports formed on said substrate; 

14 at least one of said input/output ports connecting said internal 

15 data memory with external data memory; 

16 at least two other of said input/output ports exchanging data 

1 7 passing through the interface device with an external network at 

18 media speed under the direction of said interface processors; 

19 said control point processor cooperating with said interface device by loading 

20 into said instruction memory instructions to be executed by said interface processors 

21 in directing the exchange of data between said data exchange input/output ports and 

22 the flow of data through said data memory. 

1 2. Apparatus according to Claim 1 further comprising: 

2 a second interface device operatively connected to said control point processor 

3 and having: 

4 a semiconductor substrate; 

5 a plurality of interface processors formed on said substrate, the number 

6 of said processors being at least five; 
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7 internal instruction memory formed on said substrate and storing 

8 instructions accessibly to said interface processors; 

9 internal data memory formed on said substrate and storing data passing 

10 through said device accessibly to said interface processors; and 

1 1 a plurality of input/output ports formed on said substrate; 

12 at least one of said input/output ports connecting said internal 

1 3 data memory with external data memory; 

14 at least two other of said input/output ports exchanging data 

15 passing through the interface device with an external network 

16 under the direction of said interface processors; 

1 7 said control point processor cooperating with said second interface device by 

18 loading into said instruction memory instructions to be executed by said interface 

1 9 processors in directing the exchange of data between said data exchange input/output 

20 ports and the flow of data through said data memory. 

1 3. Apparatus according to Claim 1 further comprising 

2 a second control point processor; 

3 said interface device being operatively connected to one of said control point 

4 processor and said second control point processor; 

5 a second interface device operatively connected to the other of said control 

6 point processor and said second control point processor and having: 

7 a semiconductor substrate; 

8 a plurality of interface processors formed on said substrate, the number 

9 of said processors being at least five; 

10 internal instruction memory formed on said substrate and storing 

1 1 instructions accessibly to said interface processors; 

12 internal data memory formed on said substrate and storing data passing 

13 through said device accessibly to said interface processors; and 

14 a plurality of input/output ports formed on said substrate; 

15 at least one of said input/output ports connecting said internal 

16 data memory with external data memory; 
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17 at least two other of said input/output ports exchanging data 

18 passing through the interface device with an external network 

1 9 under the direction of said interface processors; 

20 said other control point processor cooperating with said second interface device 

21 by loading into said instruction memory instructions to be executed by said interface 

22 processors in directing the exchange of data between said data exchange input/output 

23 ports and the flow of data through said data memory. 

1 4. Apparatus according to one of Claims 1 through 3 wherein said control point 

2 processor is located remotely from said interface device and is operatively connected 

3 thereto through said two other input/output ports. 

1 5. Apparatus according to one of Claims 1 through 4 further comprising a printed 

2 circuit board device and wherein circuit elements mounted on said circuit board device 

3 comprise the elements recited in said one of Claims 1 through 4. 

1 6. Apparatus according to Claim 5 further comprising: a self routing switching 

2 fabric device operatively connected to said interface device and directing data 

3 inbound to the apparatus from identifiable addresses to flow outbound from the 

4 apparatus to identified addresses. 

5 7. Apparatus according to one of Claims 1 through 4 further comprising: 

6 a housing; 

7 a backplane mounted in the housing; and 

8 a plurality of printed circuit board devices mounted in said backplane; 

9 and wherein circuit elements on one of said circuit board devices comprise the 
10 elements recited in said one of Claims 1 through 4. 

1 8. Apparatus according to Claim 7 wherein said control point processor is formed 

2 on said semiconductor substrate. 
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1 9. Apparatus according to Claim 7 wherein circuit elements on a second of said 

2 circuit board devices comprise another set of the elements recited in said one of 

3 Claims 1 through 4. 

1 10. A communications device comprising: 

2 a control point processor subsystem; and 

3 a network processor operatively coupled to said control point processor and 

4 having: 

5 a plurality of interface processors; 

6 a plurality of media interfaces; 

7 a plurality of queue registers coupling the media interfaces to the 

8 interface processors and providing queue channels through which data 

9 enters and leaves the interface processors; 

10 memory that stores data passing through said interface processors; and 

1 1 an euqueue/dequeue scheduler responsive to control signals to move 

12 data from said memory to a selected one of said queue channels; 

13 said control point processor subsystem having a control point function 



14 generator that generates and forwards to one of said plurality of media interfaces a 

15 guided frame with information that allows said control point processor subsystem 

16 access to registers and memories under control of said network processor. 

1 11. The communications device of Claim 1 0 wherein the guided frame information 

2 includes at least one word of frame control information, one word of software 

3 correlation, one guided command and an end delimiter guided command. 

1 12. The communications device of Claim 1 0 further including a frame control block 

2 register operatively coupled to said interface processors, said frame control block 

3 register storing information used to route a processed guided frame back to the control 

4 point function generator. 

1 13. The communications device of Claim 10 wherein the control point processor 
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2 subsystem includes 

3 a bus; 

4 an arbiter coupled to said bus; 

5 a CPU coupled to said bus; 

6 a DMA controller coupled to the bus; 

7 a Mailbox and DRAM interface coupled to the bus; 

8 an interrupt controller interconnecting the CPU and the Mailbox and DRAM 

9 interface; 

1 0 a DRAM arbiter coupled to the interface processor and the Mailbox and DRAM 

1 1 interface; and 

12 a DRAM controller coupled to the DRAM arbiter. 



1 14. The communications device of Claim 1 3 further including at least an interrupt 

2 line coupling the control point processor to the Mailbox and DRAM interface and a 

3 communication line interconnecting one of the interface processors to the Mailbox and 

4 DRAM Interface. 

1 15. The communications device of Claim 1 0 wherein components of the network 

2 processor are fabricated on a common substrate. 

1 16. The communications device of Claim 15 wherein the control point processor 

2 subsystem is fabricated on the common substrate. 

1 17. The communications device of Claim 10 wherein the control point processor 

2 subsystem is external to a common substrate on which said network processor is 

3 fabricated; and a communications module interconnects the control point processor 

4 subsystem to at least one of the plurality of media interfaces. 

1 18. The communications device of Claim 17 wherein the at least one of the plurality 

2 of media interfaces includes a first ethernet Medium Access Control (MAC) and the 

3 communications module has a second ethernet MAC/PHY coupled to the processor 



fopi rl from KM !(i !<S4 on (Hi/2 1/2W 



WO 01/16763 PCT/US00/20795 
58 

4 sub-system; an ethernet PHY coupled to the ethernet MAC/PHY; and a transmission 

5 media coupling the ethernet PHY to the first ethernet MAC. 



1 19. The communications device of Claim 18 further including an interconnecting 

2 device interconnecting the second ethernet MAC/PHY to the control processor sub- 

3 system; and a storage operatively connected to said interconnecting device. 

1 20. The communications device of Claim 19 wherein the interconnecting device 

2 includes a PCI bridge. 

1 21 . A method comprising the steps of: 

2 storing in an instruction memory instructions for the handling of data transiting 

3 an interface device; 

4 executing in a plurality of interface processors the instructions stored in the 

5 instruction memory; 

6 receiving a data flow inbound through an input port at media speed; 

7 communicating the data flow through the plurality of interface processors; and 

8 directing the data flow outbound through an output port at media speed in 

9 accordance with the execution of the instructions by the interface processors. 



1 22. A method according to Claim 21 further comprising parsing the data flow into 

2 a plurality of portions, storing selected portions of the parsed data flow in data 

3 memory, and directing other selected portions of the parsed data flow to a switching 

4 fabric for determination of an outbound direction. 

1 23. A method according to Claim 22 further comprising recombining the stored and 

2 other selected portions of the data flow prior to direction of the data flow outbound 

3 through an output port. 

1 24. A method according to Claim 21 wherein the step of communicating the data 

2 flow through the plurality of interface processors comprises parsing the data flow into 
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3 portions and distributing the parsed portions among the plurality of interface 

4 processors for handling in parallel. 

5 25. A method comprising the steps of: 

6 using a control point function located in a control point processor to generate 

7 a guided frame; 

8 using a device driver in said control point processor to send the guided frame 

9 to one of a plurality of media interfaces associated with a network processor; 

1 0 using Medium Access Control hardware in said media interfaces to recover the 

1 1 guided frame; 

12 storing the recovered guided frame in a memory; and 

13 routing said stored guided frame to an entity identified in said guided frame. 



1 26. The method of Claim 25 further comprising the steps of processing said guided 

2 frame by said entity according to an instruction carried in said guided frame; and 

3 routing the processed guided frame back to the control point function if required by 

4 information carried in the guided frame. 

1 27. The method of Claim 25 further including the step of encapsulating the guided 

2 frame with network routing information. 
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